The Drug Free Communities (DFC) funding opportunity announcement dropped! SNF Writing Solutions is looking to extend our 4-year win streak working with coalitions on their applications. Leave a comment or email us if interested in learning how the SNF Writing Solutions team can help your coalition apply. Please share if you know a group doing good work in their community to reduce youth substance use.
Think strategic plans have to be complicated, time-intensive, and formal documents worthy of a Pulitzer?
Who has time for that?
Come learn how to put together a “good enough” strategic plan that you could even get done while preparing that grant application due next month! See you Thursday afternoon at #gpaconf19 for a double session – come ready to work!
#grantwriting #grant #strategicplan #goodenough #keepitsimple
As I finish another grant review panel (this one Federal), I found that I had to check my “crankiness” meter – where I was on the scale when I reviewed the app – during our discussion in the team-consensus calls. Upon reflection, I decided that the applicants would do certain things that immediately changed my perception of the rest of the application. While I could temper this, somewhat, in the consensus scoring – there were many things that irritated me so much that I couldn’t (wouldn’t) let it go. And others on my review panel had their irritants too!
So, without further ado – if you really want to irritate your reviewer and have them view your application with the most critical of eye…make sure your…
1. Math is Wrong
In your budget, make sure that your summary table doesn’t add up – both for the request and any match requirement. If you want to outdo yourself in this area, your subtotals in the various sections should not match your summary. For added bonus frustration, leave out key pieces of information, such as base salary, so that the reviewer has absolutely no way of determining if your budget is accurate or reasonable.
For our objectives, make sure that your baseline and projected measures for your indicators is confusing – using percentages of percentages without mentioning what your denominator is. Reviewers will never be math or evaluation people that can figure it out; so you’ll be ok giving fluffernutter for objective measures.
For even more excitement, have numbers in various sections referred to in other sections with different values in each section – it will keep your reviewers on their toes.
2. Proposal and Documentation Don’t Match
When providing a partner list and qualifications, your Letters of Commitment that you attach should be from completely different entities – that way your reviewer has to figure out how it all fits together. Even better, have different partners in the qualifications list, letters, and budget. Reviewers all love an intricate puzzle to put together at the end of a long day! For bonus points, say that one of the partners is critical for implementation, but don’t include a letter from that partner – just your word that your most critical partner is on board is good enough.
Ditto the above for project staff. Be sure to include a random CV/Biosketch in the attachments too – reviewers love to be tested to see if they are paying attention!
When documenting your match, have a different amount in your budget than what is committed in your letters. Reviewers don’t even look at that or try to figure it out. Make sure to include various match amounts from organizations that aren’t in your budget or that you haven’t mentioned anywhere in your proposal, for good measure. Even better, just put in a dollar amount and don’t demonstrate how that number was obtained.
3. Project is Redundant of Others in the Area or from Across the Country
There’s nothing quite like reading a proposal that says that it is “unique” and “innovative” and – even better – “revolutionary to the industry” – when you’ve read the same project concept three other ways and those other proposals cited the research and project models that they are building their project from. Just put your “original” ideas out there – no need to do any best practice research during the project development phase.
4. Proposal Looks Unique without the Aid of the Provided Templates
If there are instructions or templates for the proposal or letters, no need to pay attention to those pesky details – reviewers aren’t going to look at the NOFO to know what was required – and there’s no way you would get a past recipient and someone who has written and managed similar applications/awards for several years on the same review panel – right?
When there’s a template, you would never want the reviewer to have an easy time finding information, so switching up the headings (or taking them out altogether), removing borders from tables (making it really hard to read), and abandoning the provided formatting for checkboxes and forms is highly encouraged.
5. Workplan Timeline is “Ongoing”
Every activity is always going to continue throughout the project, from beginning to end, so by all means, just give your timeline as “ongoing” for every activity.
Timelines are just wishful thinking anyway, so no need to put any thought into the exercise. Reviewers don’t need to know what’s slated for the first year versus the third year, or even the fifth year; they are just being nosey. As for milestones, we will just know that we are making progress – we don’t need to think about them or when we might achieve anything that matters in our project. We aren’t going to meet the timeline we proposed anyway – we are waaaay to ambitious in what we proposed and definitely don’t have the staff FTE count to support the work (but, shhhhhh the reviewers will never figure that out!).
I review budgets and work plans first (this is after the kids are in bed). When your math doesn’t add up – I’m jaded for the rest of your proposal – if they can’t do the math in their budget, can they manage this project? If your work plan isn’t supported by the budget, I really question if your project is achievable. I’ve worked enough projects to know what it takes and the FTE support needed to execute a project; I’m all for lean teams – but there’s a difference between operating a skeleton team and not having enough time/bodies to achieve what you set out to do in a project. In your evaluation, give your benchmarks and indicators careful thought. You will have people that have implemented projects like yours on the review panel and they have a pretty good idea what is feasible and what is inflated. Finally, take the extra time before you submit to make sure that your supporting documentation (attachments) match what is in your proposal – the reviewers really do look that them.
Here’s to (not) irritating your reviewer!
Stacy Fitzsimmons is the Founder and CEO of SNF Writing Solutions, LLC
New software programs and apps can make life wonderful for organizations. In addition to just rolling out the new system with the software company, there are other items to keep in mind.
Even with the greatest software, the human element still exists. Users and Admins alike will experience tremendous change through the new system! System champions must be ready with FAQs, training, and detailed documentation on how to perform job-specific tasks within the new system. Expect some fear, resistance, and slower reception from staff.
Software systems are wonderful tools for automation and efficiency. Nay times the new system will eliminate tasks done manually. There are also times a new system will modify or add new outside-the-system tasks. To ease the transition, prepare to discuss and document the modifications to manual tasks. This can be achieved through a FAQ or in documentation manual side notes.
Related to outside-the-system tasks, the overall business processes will be modified with the implementation of the new system. It’s okay and to be expected that the new system disrupts the status quo. Manage the chaos and ease all affected staff with good current state (pre) and new state (post) workflows and stepwise manuals. For tasks that are overly simple or only come up every once in a while, use a one to two-page Quick Reference Guide (QRG) to document the task. Create this documentation while you have access to the developer or a software representative that can provide demonstrations and answer questions.
When you started your software finding mission, or when you began the implementation with the software company, you most likely created a list of business requirements. Be sure to review this list of requirements periodically as the implementation rolls out. “But we know the requirements; why do we have to review them?” For several reasons, foremost are:
- Ensuring the software, as delivered, will meet your needs.
- Identify which business sectors/divisions will be impacted by the new software implementation.
- Guide the documentation creation efforts.
- Aid in developing communication planning for roll-out and change management efforts.
Training & Documentation
Whether provided by software company, internal resources, or a third party, training on the new system is critical. New, shiny software will be absolutely useless without a trained staff to implement the new system. The training dshould include a walk-through of the basic system navigation, and then a series of sessions on how to complete job-specific tasks. Each session should reference documentation tools available to the staff as they work post-rollout.
The training and documentation should be captured and stored in a way that can be used in the future for onboarding new staff and as a reference for staff needing a refresher or transitioning to a new job function.
In the excitement of implementing a new software, the change-management elements can often be forgotten. Include these elements in the planning stage and work on them throughout the implementation.
I wish you well on your software implementation. Should you have questions or need more information or help on any of these topics, leave a comment below, or you can email or call me.
Stacy Fitzsimmons is the Founder and CEO of SNF Writing Solutions, LLC
Update: DLT is released! Due July 17th.
For those that survived the USDA RUS Distance Learning and Telemedicine 2016 grant application season, congratulations!
As we are gearing up for another round this Spring, I reflect on the process with several lessons learned.
1) Binders are SO last season
Gone are the days where the binders are the required submission method. As of last season, Grants.gov became a submission option. I submitted by both methods in 2016 – binders and Grants.gov – both methods were successful and awarded. As Grants.gov doesn’t require the interaction of humans (i.e. FedEx or UPS), my suggestion is to go with Grants.gov this year (of course, I’m a proponent of Grants.gov anyway – I know, I’m weird!).
2) Every point counts
Some decisions can be made in a 5-point margin. Do everything you can to capture every point. Find a Native American tribe that can use some equipment and build it into your project. They get the equipment they need and you get the points for having the involvement.
Not scoring high in rurality for a telehealth project? Add some single point locations such as FQHC clinics and CMHCs. They often need resources they don’t have ready-access to receive. A telemedicine option can work great. If the clinic route doesn’t work – look to adding school nurse offices where there is a healthcare shortage.
3) You do need a matchmaker
The match requirement can be daunting. Keep track of it as you have the commitment and when you have it in writing. Vendors can’t provide match anymore – so you will have to find funding on your own. This change came down for 2016 and you better believe it will be there again. We are on our own to find the matching funds. In-kind isn’t always looked upon favorably either – so cash is king!
4) Update your statistics regularly
Updates may happen between the time you start the project and the time you submit. Since the NSLP and census data is easily verifiable, be sure that you check just before submission as to the most current data available and cite your source with a date retrieved. That way if they change again – and I’m sure they will – you have it documented as to when the numbers were pulled and there isn’t an air of mystery and suspicion about the stats if there is a substantial change.
5) Computers are needed, but they aren’t always allowable
If you request a lot of laptops or desktop units, don’t expect that the actual computer and its peripherals will be an allowable expense. While we all know you can’t have the DL or the T without computers, most were stricken from budgets last year as an unallowable expense – even after appeal! Have a plan B (or D, or M, or X) as to how you will be able to cover the expense for the computers.
I’m looking forward to a great 2017 DLT season this year! Can’t wait to see what changes this year (and administration) brings! Wishing you great success in your DLT adventures.
Stacy Fitzsimmons is the Founder and CEO of SNF Writing Solutions, LLC
Most of the time, grants are performance-based financial vehicles. You have to do something in order to get paid. In growing numbers, funders are also looking to how well you do that something. So why are organizations still viewing grant management as a finance function?
Don’t get me wrong, there is still a financial aspect to grants management. Someone, hopefully with expertise in accounting, must manage the coffers. There are many regulations and nuances to managing the dollars and cents of a grant award that cannot be ignored.
That said, there is more to grant management than just the money. Just ask any grant program manager how much time is spent on managing the budget versus everything else that has to be accomplished.
1. There has to be a relationship with the funder.
Think of your program accountant. What do they do? How do they interact with others? Would you have them be the face of your organization? Would you rely on them to deliver an eloquent message as to the status of a not-performing-as-you-expected program?
If you answered yes, I want the name of your accountant!
No offense meant to any accountant. The reason there are stereotypes is largely because there’s some truth to the description.
The biggest responsibility in grant management is establishing and maintaining a positive relationship with your funder. They not only hold the checkbook, but they are also an investor in your program/organization. They buy-in to your success. You have to demonstrate that you are competent to deliver as well as committed to the mission. This takes a good communicator with impeccable interpersonal skills and a high degree of savvy in message delivery. Yes, schmoozing!
In general, schmoozing is not in the finance department repertoire.
2. Program outcomes are not (usually) dollars & cents.
So yes, you have to show how you spent the money. But, is that what funders are really looking for? Not in my experience.
Funders are looking for outcomes that are mission focused and relevant to the advancement of a program and an organization as a whole. Measures in new learning, a shift in attitude or perception, skill advancement are sought. These metrics are evaluated based on data captured in the implementation of the program, not in the ledger of debits and credits.
3. The workplan and timelines are promises to the funder (and the budget too).
Let a group of toddlers out into the backyard and tell them they have promise they will only take 10 minutes to play and they must come back in to tell you what they did. How many toddlers will come back in 10 minutes? How many will you have to round up, capture, entice, bribe, chase, hogtie to come back in? How many will be able to say what they did?
Yep! the life of a grant manager when it comes to workplan and timeline management and reporting.
The finance department is probably used to this phenomenon when tracking down invoices or getting approvals. Are they equipped to do this for all of the grant deliverables?
Not usually. There are multiple milestones, reports, and metrics to track and analyze. Any deviation from what was committed to in the proposal requires advance permission from the funder (see #1 above!). This takes a true project management mindset with the budget only being one element of the commitment that needs to be kept.
4. Mission drives everything ‘grants’.
From the initial search to identify a potential funder through close-out of the grant, the entire grant cycle is about meeting the funder’s mission with a project or program that is furthering the organizational mission. This mission-centric cycle can only be achieved through strategic alignment and intentional delivery. While financial considerations are a part of this pursuit, they are just that – a part – of a bigger whole. Financal considerations alone cannot deliver on mission-focused activities.
5. Every grant-funded program is multi-dimensional
Make a list of all of the components of your grant-funded program. All of the pieces.
In my experience, you will see that a grant program has at minimum:
- Program mission & plan
- Program staff
- Physical stuff (supplies, instruments, location, etc.)
- Participants or a target audience
- A message to convey
- Contract with the funder
- Funds to manage
Looking at that list, you can extrapolate that each element could be construed as the responsibility of a different organizational department:
- Senior Leadership (ED, CEO, etc.)
- Public Relations/Community Affairs
- Stockholder Relations
Each element is critical to the success of the grant-funded program. Successful grant management requires one point of contact to orchestrate all of these elements. That’s not the role of an accountant!
If not Finance, where?
Where the grant operation should live is a debatable subject. Some say there shouldn’t be centralized grant operations, that individual departments can handle it all. Others (my camp) say that grant operations need a central hub. Any one of the organizational departments would work. Some entities have grants sections in finance, some in legal, some in marketing, some in the President’s suite, others in a special projects office. The grant office needs be placed where it can thrive to meet the multi-faceted demands of grant management.
My opinion: It is easier to coordinate (wrangle? herd?) equals than superiors. Reporting directly to the highest leadership position will poise the grant function to serve the organization in strategically sourcing funds and managing all aspects required of grant management. This would then require the grant office leader to be an equivalent to the finance department leader, not subservient to the finance leader. With access and equal communication to the department heads, the grant office leadership is empowered to deliver the best service to the organization and funders.
That’s what we all want, right? The best outcomes for the organization and the funder!
Stacy Fitzsimmons is the Founder and CEO of SNF Writing Solutions, LLC
How well do you remember middle school? Lockers, watching the clock for the bell to ring, changing classes, who likes whom, keeping track of your own assignments, tardies, the absence of the beloved recess…. For many students, this is their first experience with most of these areas, and when you combine all that newness with the pressures of grades ACTUALLY COUNTING for something and the social awkwardness of teens and tweens, life can be pretty overwhelming! Do you remember that horrible, hollow burning feeling in the pit of your stomach when you discovered that you forgot to bring your gym clothes? Or what about that sudden panicky sickness the first time you realized that you only get half-credit for late assignments…and it’s only late because you left it in your locker and in all your nervousness to get to class on time, you FORGOT YOUR LOCKER COMBINATION? And of course, there was THAT teacher…you remember…the one who’s only enjoyment in life seemed to come from making you sing an embarrassing song while standing on your chair for neglecting to bring your pen/pencil/calculator/book/folder/notebook to class. Just the thought of middle school makes me break out into a cold sweat!
Lucky for most of us, middle school is just a misty far-away memory. All of that turmoil and social angst are behind us, and we are stronger, smarter, and more responsible because of it. We’ve learned to manage our time, organize our papers (even if the system of organization only makes sense to ourselves!), do our work neatly and completely, and, most importantly, complete our tasks by their deadlines. Or have we? Which brings this K-8 teacher to the point of this blog post….
If grantseekers were students, what kind of grades would they be making?
Pretend your grantwriter–or the grantmaker for those of you that are grant writers–is the teacher, and you are the student. Take a good, honest look at your grantseeking habits. Do you make the grade?
- Do your assignments. The first step to writing a successful grant is to make sure you complete all of the required tasks. Accurately fill in the basic company information. Send the requested copy of your 501c(3) tax letter. Email that list of boardmembers and their bios.
- Turn your stuff in on time. Let’s face it….we are all busy people. On any given day, there is too much work to do, and not enough time in which to do it. However, grants wait for no man (or woman), and the unfortunate thing is, if you do not get your grantwriter the requested information in a timely fashion, she cannot complete your grant application by the deadline. Executive directors: Did your grantwriter send you an email asking you to approve, click, and sign the grant for the final submission by the grant’s deadline? If you don’t, then you are only hurting yourself and your organization.
- Follow instructions. Grantmakers are like teachers…they want things done in a specific way. If you do not comply, you’ve wasted valuable time, energy, and resources, and your grant will go immediately into the recycle bin without a second thought. Did you follow page counts, font size, margin, and spacing requriements?
- Listen & Pay attention. Really, truly listen, to the grantmaker’s description of the grant….to your grantwriter’s suggestions for improvement or for needed items…. Pay attention to due dates….to needed information….to grant period reporting requriements….to it all!! If you have a hard time remembering, take notes or ask for an email copy of the grant instructions. Set up reminders on your phone or calendar (remember those assignment notebooks from middle school?). There are some magnificent apps out there. The important thing is to find a system that works for you.
- Do your work neatly and completely. Just like in school, it will help you avoid misunderstandings, mistakes, and problems down the line. Did you receive that grant? Great! Please keep the required receipts, statistics, and other required information, and file your reports COMPLETELY and neatly.
- Respect yourself and others. As with anything, please respect the time and energy of those who are involved in the process of writing your grant application. It takes many hours of hard work to write a successful grant, and sometimes grantwriters feel like we are constantly nagging our clients to provide us with timely, completed information that is vital to the grantwriting process. Do you remember that kid in your class whom the teacher constantly had to nag? Jake, where is your pencil? Jake, are you working on your report that is due Friday? Jake, have you read chapter 5? Jake, did you turn in your homework? Jake, are you paying attention? When you honor your grantwriter’s time and efforts by doing all of the things above, you eliminate (or at least drastically reduce!) the need for your grantwriter to constantly remind you for items required to obtain your grant.
In what areas do you need to improve? Are there areas in which you are getting tardies, half-credit for late assignments, or 0 participation points? How will you improve your grade in Grants 101?
Lisa Wagner is an Associate with SNF Writing Solutions, LLC.
How to Show Appreciation to Funders (and Non Funders!) That Will Get You Noticed
By Amy Shankland
You got the grant. You’ve celebrated with your staff or client and the organization is ready to implement the project. You’ve already talked about both the regular and financial reporting requirements and are feeling ready to go.
Or… you didn’t get the grant. In the best case scenario, you’ve talked to the funder to find out what you could have done better and why the panel didn’t select your application. In the worst case scenario, you had to find out that you didn’t get the grant through some online article. The funder didn’t even email you a rejection (don’t we all love those cases?)
In either situation, you need to send the funder a thank-you. Yes, you read that right – whether you are funded or not, you absolutely have to show the funder some appreciation. And not just a two-sentence thank you that you dashed off in an email, either.
Not that an email thank you note is a bad thing. More on that later.
I know grant professionals are busy people, and taking the time to write a good thank you note may seem unnecessary. But now, more than ever, the personal touch of a real “thank you” can help an organization rise above others in the competitive world of grants. In fact, if you’re not funded, it can help you move to the front of the line in the next application round.
So what are some great ways to thank a funder? I’ll start with some simple ideas:
- Have one of the organization’s clients write the thank you. Why not delegate? This can be anything from a heartfelt drawing from a child who has benefitted from an after school program to a beautiful note written by a senior citizen who now has transportation to medical appointments. Talk about an impact!
- Pass a thank you card around at the next staff meeting to have everyone sign it. A real card that you can actually send snail-mail style. This is also a way to delegate, but is still effective.
- Take pictures of the project in action and email them to the funder (remember when I said an email thank you note isn’t a bad thing?) This is probably one of my favorite ways to show appreciation to funders. I simply take a couple of photos and email them to the program officer with a big headline saying “YOU made this happen!” The agency can then share them with their board, the grant panel, etc.
- Use social media. A true no brainer, right? Check with the funder for a good hash tag and promote the heck out of them with it.
You can take some other steps that are a bit more work, but can really “knock their socks off”.
- Host a yearly “thank you” breakfast. Have staff and board members serve a continental breakfast, hopefully donated from restaurants and stores, to local funders. This takes no more than a couple of phone calls and 90 minutes on a weekday morning, but can make a huge impression.
- Host a “thank a thon” with board members making actual phone calls to express appreciation to granting agencies. Prepare a simple script for each board member, give him or her 4-5 program officers to call, and you’re done.
- Have a site visit with a “thank you” theme. Not only will grantors get to see the project in action, but they’ll be personally thanked by some of the individuals who are benefitting from it. Talk about powerful!
There are literally dozens of additional ways you can show appreciation to funders, but these are my favorites. Feel free to share what you like to do in the comments. But remember, no matter what, always take the time to show a funder appreciation. It will definitely pay off in the future.
Amy Shankland is a former Associate with SNF Writing Solutions and guest blogger.
I was recently asked what the number one challenge is for local governments. As a former employee of a city in Indiana, I know without a doubt that the answer is property tax caps.
These caps were first introduced in 2009 and were meant to help taxpayers. While the caps have certainly accomplished that goal, they have had a dramatic effect on local governments, especially those that are not experiencing growth. This has led to lost revenue for many communities.
According to a December, 2015 Indianapolis Business Journal report, DeBoer and retired Community Research Institute director John Stafford stated that property tax caps have hit older, industrial cities hard, while the growing Indianapolis suburbs and thriving college towns are faring quite well.
I’ve witnessed the work of top officials at many cities, towns, and counties as they cut costs and slash budgets. I understand that everyone wants governments to work as efficiently and lean as possible. I believe most are accomplishing that goal.
However, the tax caps have still caused some unexpected damage. For example, neighboring school districts are seeing drastically different property tax revenues per student due to coverage areas. And I think we’re just beginning to see tax cap consequences like these.
So what can local governments do in order to keep providing vital services to their communities? Some, like the Central Indiana municipality I recently worked for, are looking at alternative funding such as trash fees. While every other city and town in the county has charged a trash fee, this city is still facing quite a battle to implement one.
Communities are also taking a closer look at local option income taxes for new revenue. As budgets continue to get squeezed, local government staff members will work to apply for more federal, state, corporate, and foundation grants.
New crowd funding campaigns, like those led by Citizinvestor http://www.citizinvestor.com/, are popping up for community projects such as dog parks, public art, and trails. These have been successful for some local governments as long as they invest the time and effort to promote the campaigns.
Like many organizations and businesses, local governments are being asked to do more with less. Alternative funding sources and grass roots community support will hopefully help us all continue to benefit from public safety services, parks, strong infrastructure, and more.
Amy Shankland is a former Associate with SNF Writing Solutions, LLC and guest blogger.
It might as well be a diagnosis of the plague!
Most of us associate evaluation with our annual employee performance review. No one likes the way performance evaluation is generally done. Not the manager. Not the employee. It’s probably the most dreaded, feared, heart-wrenching, ulcer-causing activity done in the business world.
So why would we want to put our entire program under that kind of microscope? Could anything be more repulsive?
I’ve really only encountered two types of people when it comes to evaluation: those that avoid it like the plague, and those that are so passionate about it that they will shout about its virtues from the rooftops.
Can you guess which I am?
Okay, so I am one that would shout it from the rooftops. Why, might you ask?
The simplest explanation is, I like to know where I stand, and what people are thinking. I like to know what I am doing really well, and what I need to work on in order to be the best “me” I can be. These concepts transcend my work and personal life.
For those like me, we can get geeked out pretty quickly when we start talking data, outcomes, process, budgets, the benefits of measurements, and what can be measured versus what should be measured. I am certain my pupils just dilated and my heart skipped a beat or two writing that sentence, and I didn’t even go into the difference between an output and an outcome!
For those whom evaluation is the plague, you may have just experienced sweaty palms, a blood pressure spike, hives breaking out across every limb, and may even feel the start of a migraine coming on just from reading that sentence!
So for those of you who think evaluation is like the plaque, know this – it really doesn’t have to be that bad. Breathe deeply and repeat that sentence again if you need to. It doesn’t have to, and frankly shouldn’t be that bad.
I know, I come from a very special place when I say that, but…really…as business professionals (yes, nonprofits, universities, and governments are businesses too!), and I’d stretch to even say as humans, we need to know if what we are doing is working. Otherwise, why are we even doing it (other than job security)? Don’t you want to know if your program is as good as you think it is?
In an environment of “proving your worth” evaluation can be the best prescription: it can show that what you do is worthwhile and you can also show that you identified what was wrong and made efforts to correct course. That’s pretty admirable.
So, next time you hear the word “evaluation” take a deep breath and start the process: 1) plan the evaluation, 2) conduct the evaluation, 3) determine the results of the evaluation, and 4) create and implement a game plan for addressing the results. Yes, this is an over-simplified view of the process, but it’s the framework that can get you to a better place mentally to face the project.
Also remember, that you don’t go though evaluation alone. It’s an all-hands-on-deck type of project. Even better, the best evaluations are those done by neutral third parties (hence you don’t do the bulk of the work!).
So again, take that deep breath. Now, here’s a brief overview of what you can expect when conducting an evaluation project.
What can you expect?
In general, an evaluation project will include the following components.
A literature review:
What are the industry standards for the program?
Research pertinent to your industry and particular program/activity is used to inform the final evaluation design and the outcomes evaluation indicators.
An evaluation design:
What is the focus of the evaluation and how will it be conducted?
The design will be finalized as part of the proposed evaluation project. All outcomes, indicators, and the methodology most appropriate for your organization and target program are reviewed or created. During the evaluation design, interview instruments, process evaluation objectives, outcome indicators with operational definitions, and project charter will be created using appropriate industry frameworks for evaluation (e.g. CDC Framework for Program Evaluation in Public Health and Program Evaluation Standards). The SNF Writing Solutions methodology also includes the Lean Six-Sigma DMAIC model.
What do people think about the program?
Interviews with key stakeholders (leadership, employees, management, board members, possible clients, and funders) are conducted to assess program impetus, implementation, and interaction experience. The stakeholder pool and interview schedule is coordinated with the evaluation champion in your organization. These interviews will inform the remainder of the evaluation schedule and serve as a progress gate for any evaluation design modifications before moving forward.
What data do we have versus what we need?
Information. Excel Sheets. Databases. Calendars. Websites. Marketing literature. Budgets. Tally sheets. Meeting notes. The list goes on.
Depending on the focus of your evaluation, different types of data are gathered to feed the evaluation process. Some will be readily available and some will need to be culled from various sources. With the evaluation design completed, the data needed to compete the evaluation has already been determined and must be pulled together. The SNF Writing Solutions team includes data-gathering and data-entry experts that aid organizations through this process of gathering data and even creating new data sets.
How well is the program executed in relation to the intended model?
The process evaluation assesses the extent to which the target program/department/ service is delivered as planned as well as the facilitators and barriers to implementation. The process evaluation will clarify how, why, and for whom the program works and which components are most/least effective. Through the process evaluation, an understanding of the opportunities for quality improvement and/or corrective feedback is established as well as determining the feasibility for replication and/or expansion of the program operations (remember, funders love programs that are replicable). Consideration of the reach of the program, the intervention dose delivered and the dose received, as well as the implementation and model fidelity within the context of the program environment will be included in the evaluation design.
The process evaluation with SNF Writing Solutions will generally include a Lean Six Sigma review of the program with a process documentation review, analysis of client and organizational service expectations, observation of all organization practices (with regard to HIPAA or other legal requirements as appropriate), documentation of current state, and statistical analysis of current state against service expectations.
How are costs balanced with benefits?
A cost evaluation looks at the impact of program to the cost of the program/service for the target population or stakeholder (can be organization as a whole). Methodologies for the cost evaluation can vary. The SNF Writing Solutions evaluation includes a review of dollars spent versus income (or funds available in the case of a grant-funded program) and population served and a cost-benefit analysis (CBA) of providing services. As part of the cost evaluation, the return on investment (ROI) is generally calculated for the program. In reviewing the financials and CBA for the program, the feasibility for replication and/or expansion of the program in achieving outcomes can be considered. A high cost program can still be a sound investment for a funder if the results are impressive and long-lasting.
Are we meeting the needs of our customer?
When thinking of evaluating a program, this is the evaluation that most think of: assessing the impact of a program on the societal improvements sought based on existing or determined short-term and long-term activities/services targeted in the evaluation. The literature review and stakeholder interviews will be used for qualitative analysis of the program. SNF Writing Solutions includes text theme determination. Quantitative data analysis of service provision versus expected outcomes will include a review of all outputs and outcome indicators from the program using a correlational analysis. The outcomes evaluation can include the feasibility for replication and/or expansion of the program in meeting societal needs. If needed, a baseline for indicators can be retroactively established from organizational data prior to the implementation of the project/program.
What did we learn?
The final deliverable of a project is largely determined by the client-side champion of the evaluation project. A report will generally include the interpretation of all evaluations with conclusions regarding the program. The report will include statements regarding the merit, worth, and significance of the program/service and interpretations of the findings against the standards identified in the literature review, evaluation design, and stakeholder interviews. Recommendations for specific actions to take into consideration for improvement, replication and/or expansion of the program will also be included in the report.
At the conclusion of the evaluation, SNF Writing Solutions shares the methodology and results with organizational stakeholders, and, at the request of the organization, will assist in presenting to funders, staff, or other groups, and can prepare the findings for dissemination as a potential white paper, journal article, or for conference presentations as opportunities are available.
What will we do with what we learned?
The evaluation process is only as good as the follow-through on the findings. Many things will prove to be working and should be left alone – don’t fix what isn’t broken. That leaves those items that weren’t quite what you were expecting, or had not gone planned. Take a good look at those items and figure out the root cause (this is why SNF Writing Solutions uses the Lean Six Sigma approach – you will already know root causes) and develop potential fixes for the root cause. Create an action plan to implement the change (if a big change, you may want assistance with change management) and monitor the effects of the changes you implement. This ongoing measurement and evaluation can be an extension of your relationship with the evaluator. As you see improvements, acknowledge and celebrate them!
Evaluation is not a one-and-done experience. Those organizations that are successful are always measuring (the right things) and evolving to meet the demands of their customers within the scope of the organizational expertise and mission. This is accomplished with rigorous and continuous evaluation of the organization and individual programs. SNF Writing Solutions generally includes post-evaluation follow-up and implementation support as part of any evaluation project.
Hopefully, with better overall evaluation experiences, those employee performance evaluations are also a little less stressful for you – everyone will know, on a regular basis, where everyone stands!
Here’s to the evaluation plague – turn it into your passion!