Police Performance Evaluation Archives : Benchmark Analytics

Municipalities, Insurance, and Law Enforcement Risk Management

Posted on September 29, 2021October 14, 2021 by Nicholas Frankel

A new era of police reform has brought with it increased public attention to the liability costs of law enforcement, specifically in cases of misconduct settlements and risk management policy. Though the overall number of claims brought against law enforcement agencies has been relatively flat in the previous decade, the cost of misconduct settlements has increased dramatically. As a part of the broad continuum of reform efforts currently underway throughout the country, departments and municipalities are taking a close look at their risk management strategies to control liability costs.

Risk Management Basics

Risk management in law enforcement entered a new stage with the Supreme Court’s decision in Monroe v. Pape (1961). This decision, stemming from a high-profile misconduct claim, allowed individuals to sue law enforcement officers for damages in cases related to the deprivation of constitutional rights. The ruling opened a new area of risk for departments and municipalities, making it necessary for them to address legal costs and potential settlements arising from misconduct-related litigation.

Commercial insurance companies were the first to offer policies specifically designed to help municipalities and law enforcement agencies mitigate their exposure to the financial risk of litigation. These policies worked on the basic principles of commercial insurance: grouping and limiting risk factors. Insurance market disruptions of the late 1970s and early 1980s led some municipalities and agencies to turn to risk pools and self-insurance. Now the vast majority of agencies and municipalities use at least one of these strategies.

“These insurers influence law enforcement agencies in various ways. They shape the content of departmental policies on things like high-speed pursuits and the use of force. They have a hand in how officers are trained, and how much training they receive.” John Rappaport, Professor of Law, University of Chicago Research Matters Blog

There is no one “right” strategy for a municipality. The complexity of local and state laws and the unique circumstances confronting leaders in different cities and departments make it difficult to make overly broad characterizations about any one strategy, let alone assess its efficacy in a general way. Though all of these insurance strategies have the same goal – managing risk in law enforcement – they take decidedly different approaches. Here are some of the critical points in each risk management strategy:

Municipal Risk Pools

In the law enforcement arena, risk pools are the most common kind of risk protection employed by municipalities, with a significant number of small- to medium-sized cities participating in these organizations. They came into prominence in the early 1980s to mitigate the cost fluctuations that many municipalities were experiencing due to disruptions in the commercial insurance market. Practically, they serve a similar function to commercial insurance companies. Cities, counties, or other government entities group together to pool their risk to diversify it and to control costs.

Risk pools are specialized “non-profit, mission-driven” entities that, optimally, mean cost savings for municipalities compared to the fees and need for profit in commercial insurance. They often employ retired police officers and administrators as consultants to help guide member municipalities’ risk management policies. Additionally, many risk pools engage with third-party data analysis providers to understand risk from a research-based perspective. While the recommendations provided by in-house staff and third-party firms aren’t always binding, this fluency in the language of law enforcement, coupled with an understanding of the nature of the profession in general offered by risk pool officials, helps engender a spirit of buy-in from member agencies.

Commercial Insurance

Today, commercial insurance is most often utilized by midsized cities with populations around 100,000 residents. This insurance works much like other types of commercial insurance, with insurance providers assessing risk, charging a premium, and providing coverage based on the terms of the agreement. In terms of overall costs, they can be seen as more stable than alternative forms of municipal insurance, though sometimes more costly. Commercial insurance companies typically offer many different types of insurance, leading to a much more diverse portfolio of risk than other means of municipal insurance. After insurance pricing and supply fluctuations of the late-1970s and early-1980s disrupted coverage for some municipalities, the industry is now well-regulated and better-capitalized, offering another layer of financial stability to cities.

Insurance companies use loss prevention analysts to study an agency’s policies to understand better what’s working or where they can offer specific procedures or policy suggestions. The companies also utilize underwriting and price setting to incentivize adopting policies they believe will reduce risk. The relationship between insurers and municipalities is a business relationship — meaning that while these recommendations and pricing structures do create an incentive, they typically are not binding.

Self-Insurance

Self-insurance as a practice is most frequently, though not exclusively, seen in larger cities with extensive tax bases and substantial budgets. It rarely means “going without” an insurance structure but instead carefully assessing risk and planning a budget to cover litigation costs. This type of risk management gives municipalities the greatest autonomy in setting policy and, potentially, if not managed effectively, more risk exposure.

Risk management practices are generally at the municipality’s discretion. Consent decrees and state mandates can also play a significant role in setting policies related to risk management. The robust budgets of many larger cities can help them absorb the costs of litigation and more easily put practical new risk management tools into places like body-worn cameras, smart car technology, or early intervention systems.

Risk Solutions

In response to an urgent need for more effective risk management strategies in law enforcement, Benchmark Analytics is launching Benchmark Risk Solutions™ a first-of-its-kind product suite using evidence-based risk analytics, advanced predictive modeling, and proven loss-control interventions to mitigate law enforcement liability. By proactively assessing risk, the product suite identifies loss-prevention actions and proven interventions to manage these underlying risk drivers while continually measuring its effectiveness. This suite of products is designed to meet the needs of every insurance strategy, enabling public risk pool professionals, municipal risk managers, law enforcement command staff to better control costs and achieve greater financial stability. See our press release for more information.

Look for future posts where we will be exploring other aspects of law enforcement and municipal risk management.

Reference

Rappaport, John. “How Private Insurers Regulate Public Police.” Harvard Law Review. 130.6 (2017). 1541-1613. Web. 25 September 2021.

Police Reform and Escalating Misconduct Settlements

Posted on July 8, 2021September 2, 2021 by Nicholas Frankel

A crucial element of the police reform discourse is the rising cost of police misconduct settlements and the impact they have on municipal budgets. Elected and agency officials must contend with these costs though taxpayers in most instances are subsidizing the funding used in settlements. There is ample reason for law enforcement personnel, lawmakers, and taxpayers to all be keenly interested in the cost of these settlements. What do misconduct settlements look like? What is being done to mitigate the costs of misconduct settlements? These are questions this article endeavors to answer.

Misconduct Settlements: A Nationwide Concern

Even tracking the overall costs of police misconduct settlements has proven a significant challenge for researchers. There is currently no national reporting database and municipalities’ approach to record-keeping can vary widely. On a national level, the data just doesn’t exist to present a broader picture of how much misconduct settlements cost taxpayers. In an effort to address this lack of data, in March of 2021, the Cost of Police Misconduct Act was introduced into Congress, which seeks to compel reporting to federal authorities. Whether or not this bill will be passed into law is presently unclear, but it does represent one of the most high-profile efforts to explicitly tie the costs of settlements with the pushes for reform.

Despite the lack of specific data, it is well-understood that the costs of misconduct settlements are quite substantial and create strain on city budgets. In a recent survey of 31 of the 50 cities with the highest police-to-civilian ratios in the country, available data shows settlements cost these municipalities more than $3 billion over the last decade. Though the dataset is incomplete, it illustrates the substantial figures municipalities are contending with in settling misconduct allegations. Until recently, these costs were not typically figured into municipal budgets for policing and related costs.

Further complicating matters is how municipalities pay for misconduct settlements. In general, many small to medium-sized cities carry some form of liability insurance or risk-pool while the largest cities are either self-insured or will issue bonds to cover settlements and their related costs. Both approaches have their drawbacks. Bonds accumulate interest and servicing fees while insurance typically is funded via property taxes or other public user fees. In either model, it is once again taxpayers that ultimately bear the cost.

These settlement costs appear to be trending upwards too. In a survey of ten cities, the Wall Street Journal found misconduct settlement amounts rose from $1 billion between 2010 and 2014 to $1.6 billion from 2015 to 2019. There is no one reason for this rise but it is generally thought that things like increasing public pressure in favor of reform efforts and the widespread use of smart phone cameras have contributed to this rise. Additionally, some agencies and municipal governments look towards a settlement as a way to avoid a drawn out and expensive court battle.

Agencies Respond

Law enforcement leaders, elected officials, and taxpayers all have an obvious interest in controlling misconduct settlement costs. These unplanned expenses can significantly impact municipal budgets and can force unexpected reallocation of funds. Agencies and municipal governments are employing a number of different methods to control these costs. Here are some of the most common and effective examples:

Additional training is a strategy agencies and municipalities are using to reduce the likelihood of an adverse event leading to a settlement. Training requirements are frequently a component of new reform legislation being passed at the state level. De-escalation training and coursework related to identifying and responding to mental health crises are becoming more prevalent as are new standards in use-of-force training. Effectively managing and tracking officer training is seen as a proactive tool aimed at preventing law enforcement encounters that end up in settlements.
In recent years, the companies that insure small to medium municipalities are responding to the growing cost of settlements by exerting more control over agencies’ operations. This insurance risk management oversight takes on many forms such as policy audits, use-of-force simulators, and even ride-alongs to observe officer behavior. In some cases, insurers can even influence staffing decisions. Other municipalities participate in risk pools in which they “share” risk. The Association of Government Risk Pools connects member cities and facilitates collaboration while providing best standards and education.
Improvements to data collection are furthering policymakers’ and agency leadership’s ability to base decisions on rigorous analysis of data. This encompasses everything from body-worn cameras and audio recording devices to Internal Affairs and Use-of-Force metrics that are tracked and monitored via software. With more comprehensive and smarter data collection, policymakers and agency heads can be more confident in their decision-making, knowing it is based on a holistic view of performance and personnel data.
Early Intervention Systems (EIS), are software suites designed to help agency leaders monitor officer behavior and, ideally, intervene before any issues arise. Benchmark Analytics’ First Sign® Early Intervention System is preventative by design and more sophisticated than other, trigger or threshold-based systems, allowing leaders to identify off-track officer behavior before it rises to a level of seriousness that could involve an out-of-policy incident.
Once an EIS has alerted an agency’s leadership to the potential for performance issues, it is up to them to implement corrective measures to get that officer back on track. This often involves additional support like further training and mentorship. Benchmark’s Case Action Response Engine® (C.A.R.E.) helps track not only that assigned interventions are being completed but that officer performance is in fact on a path to improvement.

Elected officials, taxpayers, and agency leaders all have a vested interest in seeing the costs of misconduct settlements minimized. Data collection and analysis pertaining to officer performance are vital parts of the conversation around reducing the overall costs of misconduct settlements. By using new research-based software tools to better understand this wealth of data, agency leaders are empowering themselves to make the decisions necessary to ensure police funding is wisely spent on things like agency growth and training — and ultimately reducing the likelihood of problematic behavior that can potentially contribute to the rising cost of misconduct.

A Year of Change: A Look at State-Driven Police Reform Efforts

Posted on June 16, 2021June 16, 2021 by Nicholas Frankel

It would be an understatement to say that in the last 12 months the world has changed in ways no one could have predicted. A global pandemic disrupted social norms, healthcare infrastructure and economic stability. Add to that a series of high-profile law enforcement incidents that ultimately resulted in renewed calls for police reform — and it’s easy to see how historians will look back at this year as a pivotal moment for change in the face of challenge and adversity.

One of the outcomes was an unusually active legislative environment, with states from coast to coast focused on enhanced as well as new police reform legislation. During this tenure of rapid change that continues today, it’s important to step back and look at the big picture in state-level policing reforms — to more thoroughly understand them in a broader context. According to a recent analysis by The Washington Post more than 2,000 policing-related bills have been introduced across the country since June of 2020. By unpacking and understanding the broad aims of these bills, departments and their leaders can better anticipate potential reform efforts that affect them and implement more effective change management strategies in response.

Typically, most states have a pre-determined legislative period, with some not even meeting on an annual basis. In the last 12 months, 23 of them held special legislative sessions outside of their normal legislative periods. While many of these sessions were called to tackle the impacts of the pandemic and provide special funding for first responders, it also gave lawmakers the opportunity to address urgent calls for police reform specific to use of force as well as accountability and transparency.

Newly compiled numbers from the National Conference of State Legislatures show that almost half of the states enacted some form of legislation that changed the way police operate. These reform efforts covered everything from physical interactions during arrests to record-keeping and compliance. In addition to these 24, several more states passed oversight reforms, calling for commissions or other groups to study ways to improve standards and transparency.

Two of the most common types of reform have been those addressing the use of neck-restraints, or chokeholds, and those mandating an officer’s duty to report or intervene. 18 states and the District of Columbia passed laws limiting the use of neck restraints with ten states banning them outright. Other legislation passed in 12 states requires officers to report and, in many cases, attempt to intervene to prevent out-of-policy instances of force by a fellow officer. Further, some states have enacted broader, more comprehensive reform measures — for example:

Colorado Governor Polis signed into law a broad accountability bill titled Enhance Law Enforcement Integrity, where agencies will be required – among other things – to report all details of all use of force incidents that result in death or serious bodily injury; track all instances when a peace officer resigned under investigation for violation of policy; and maintain a database on officer de-certifications
Governor Sununu of New Hampshire signed an executive order establishing the state’s Commission on Law Enforcement Accountability, Community, and Transparency. Benchmark Analytics was selected to develop and implement a state capture of employment, training, and disciplinary history as well as certification across 200+ statewide law enforcement agencies.
Washington state Governor Inslee recently signed a dozen police accountability bills into law, notably including the creation of a statewide database of police use of force incidents, through the Washington State Office of the Attorney General.
New York, where Governor Cuomo issued an executive order that every law enforcement agency in the state adopt a reform plan by April 1, 2021. Titled New York State Police Reform and Reinvention Collaborative, the order requires that agencies develop clear policies specific to Use of Force and Early Intervention.
In Virginia, Governor Northam signed sweeping legislation comprised of a dozen bills covering everything from use of force and tactics to crisis intervention protocol, all areas requiring additional training and certification for officers.
The state of Utah passed several law enforcement bills signed into law by Governor Cox, including requiring Utah agencies to meet the FBI’s standards for reporting use of force — as well as setting up a panel to consider and make recommendations on data collection.
After the passage and signing of the Minnesota Police Accountability Act of 2020, Benchmark Analytics partnered with Minnesota POST to implement a statewide portal to capture internal affairs misconduct complaints across 400+ of the state’s law enforcement agencies.

Additionally, some states are mandating the reporting of incident data to both state and federal agencies. These reporting requirements as part of oversight trends are generally aimed at increasing the dataset available to the communities that agencies serve — as well as policymakers, researchers and data scientists. One of the thoughts behind these new requirements is that, with a larger dataset to study, it will better enable evidence-based decision-making at multiple levels of government and law enforcement.

Most observers see these legislative actions as the beginning, rather than conclusion of a process towards meaningful change in the way law enforcement agencies track and manage their forces. Comprehensive personnel management systems can make a substantial difference in the ease of which this data is monitored internally and reported out to various agencies and oversight bodies.

The Benchmark Management System (BMS), for example, features reporting tools designed to simplify data retrieval and review, putting incident-based data for individual officers, comparative stats for units, and a host of other data analysis features in one, simple-to-implement tool. This not only allows leaders to ensure accurate and timely milestone reporting to satisfy the requirements of any new legislation mandates, but day in and day out it empowers them to monitor performance data in real time, giving them an up-to-the-minute picture of the officers under their command. BMS also includes a next-generation Training Management System to help agencies track and manage any additional requirements and certifications as a result of new reform standards.

Law enforcement agencies are experiencing a time of rapid change in the way they do their work. New legislation will undoubtedly continue to shape not only law enforcement practices, but also training and the way data is managed and reported. By having a deeper understanding of not just the mandates of new legislation but the trends they represent, law enforcement agencies and their leaders can better rise to the occasion, ensuring their officers are well-equipped to navigate these changes.

Our next article will be looking at the role that state POST organizations are expected to play in these latest reform efforts.

Go Beyond a Standalone Software Application with a Law Enforcement Software Suite

Posted on August 27, 2020August 27, 2020 by Amy Vracar

Law enforcement software has changed immensely over the past decade. We have seen software innovations that help improve administrative workflows, such as use of force or internal affairs reports, as well as software that captures and utilizes data to help police chiefs make decisions on how to best serve their communities. More often than not, these innovations are presented as single-point solutions — versus as part of an integrated, holistic suite of offerings.

These standalone software applications are designed to address one specific agency need, such as training management, performance evaluations, or Covid-19 personnel tracking. While these systems capture and track information for the task they were built for, in the end they are disparate cogs in a machine that requires seamless integration and connectivity.

The Complexities of Standalone Software Applications
Until recently, the market has driven how agencies are able to purchase software solutions for their myriad of needs. And by that we mean, one by one: one platform for early warning and intervention . . . one platform for training . . . one for Covid-19 tracking . . . and so on and so on. And while these single-point purchases solve individual challenges in the short-term, over time they can lead to increased complexities within the agency and its administrative process.

For example, agencies that utilize multiple software applications can experience integration challenges and find it difficult to compare and correlate data across applications. As a result, many administrative hours are spent on manual processes or even spreadsheets, in order to link information together from these different standalone systems. This takes valuable team time away from conducting more important core duties. And on top of all that, by the time all the information is integrated as needed, it may already be outdated and inaccurate. The unintended consequences? Agencies possibly making critical decisions based on inaccurate information . . . or making a hasty and potentially risky decision without benefit of the full information picture . . . OR, in lieu of that complete picture, taking no action at all.

Additionally, IT departments spend time and money maintaining, upgrading or acquiring new versions of each standalone application. When one application has a new version, it may require additional integration and maintenance with the other standalone systems in order for it to work, which in the end leads to an increase in hours and costs to maintain. All this, and we still see some agencies “make do” with multiple software applications, even if that strategy may not serve their various stakeholders in the most efficient and effective way possible.

The Benefits of a Single-Provider Software Suite
A single-provider software suite is a collection of software applications that have correlative features and functionality for law enforcement agencies. These suites also share a similar user interface and have the ability to easily exchange data with each other. Agencies who utilize a single-provider software suite experience numerous benefits. Here are a few below:

Data in one place.
The key to avoiding manual work and time-consuming tasks is to ensure your agency has the ability to create, update, or modify data all in one place. For example, with standalone systems, personnel may need to log into several different applications to complete functions. With a single-provider software suite, individuals can utilize any portion of the system and input data that can be easily shared across other portions of the suite — saving valuable administration time. Additionally, the right software suite can seamlessly integrate all data, automate data processes and update information in real-time — making it is easy to generate reports and compare data. Automating such processes also allows agencies to minimize personnel time spent on data-mining activities.
Decreased redundant IT tasks.
Agencies with several standalone systems consume valuable IT time managing, maintaining and upgrading each individual system. A single, holistic software suite streamlines efficiency and minimizes redundancy in IT tasks.
Consistent experience.
Standalone systems will have their own unique user interface designs. With a single-provider software suite, agencies get a consistent UX, which can minimize confusion, reduce learning time and increase overall usability.

Ultimately, with a single-provider software suite, agencies achieve transparency, streamline data, and manage department functions in one place. For these and other reasons, leading agencies are turning to Benchmark Analytics and its suite of personnel management software, which includes the Benchmark Management System^® (BMS), First Sign^® Early Intervention and Case Action Response Engine^® (C.AR.E.).

BMS is a comprehensive software suite that features seven analytics-driven modules, which include: 1) Training 2) Use of Force 3) Internal Affairs 4) Activity 5) Officer Profile 6) Performance Evaluation and 7) Community Engagement. These seven integrated modules capture critical data and departmental reports that are easy to view in the BMS dashboard.

First Sign then leverages the data in BMS and analyzes it to identify officers who are exhibiting both on-track and off-track behavior. Once off-track behavior has been identified in First Sign, Benchmark expedites thoughtful and effective early intervention with C.A.R.E. — a proactive, targeted support program that features research-based case management modules for officer-specific interventions.

To learn more about the Benchmark Analytics Software Suite, visit: https://www.benchmarkanalytics.com/police-force-management-blueprint/

Or, contact us today at https://www.benchmarkanalytics.com/public-safety-demo/

Understanding the Potential for Data Analytics in
Law Enforcement

Posted on September 4, 2019September 4, 2019 by Nick Montgomery

Law enforcement generates extraordinary amounts of data. Every call and dispatch, every arrest, and most interactions with civilians create data an agency can use for analysis. Historically, the practical application of this information has been limited to crime analysis and prevention (e.g., hot-spot policing), but the increasing availability of data and analytics makes it possible for agencies to apply similar strategies to technology-driven personnel management.

Law Enforcement’s Data Ecosystem

Much of an agency’s data is captured through deeply integrated platforms such as Computer-Aided-Dispatch (CAD) and Records Management Systems (RMS). The emergence of CAD and RMS allows police leadership to streamline everyday operations while tracking patterns in historical data to develop sophisticated proactive strategies for crime prevention.

As agencies continue to upgrade to digital systems – including the deployment of equipment like body-worn cameras, dashcams, and V2X telemetry – it becomes easier to derive insights from officer activity. New technologies overlay existing systems to create a digital ecosystem that produces an increasing volume and quantity of data. This growth makes analysis more important, more complicated, and much harder to do well. However, it also creates an opportunity to do more with agency data.

For example, an agency could expand the focus of its data analysis beyond a criminal lens to include performance management of its officers. A recent article by Michael Armstrong, Bill Bratton and Sean Malinowski:

Performance Management has been described as an ongoing process to establish and maintain a high performance culture, focused on aligning individual objectives with the overall goals of the organization. Performance Management is characterized by inclusion and agreement on goal setting, establishing standards of measurement and immediate and ongoing collaboration and feedback. (Armstrong, M. (2006). Performance Management. London: Kogan Page)

In other words, performance management is effectively working with your officers, leveraging strengths and managing weaknesses to improve the overall outcomes of your agency’s police work. This begins with identifying what data to capture, how to effectively do so, and what the data you collect actually means. Most departments have an abundance of officer data but very few have managers trained to conduct meaningful data analysis.

In a previous blog, we connected this analysis of data to agency transformation (see the 5 Stages of Transformative Management for Law Enforcement). We mapped a typical agency’s journey from an undefined process to a transformative one and the distinct stages in between (including analytic). Well-documented processes with automated data collection get agencies pretty far along the path – without this data, you’d have nothing to analyze – though it takes more than just data to transform an agency. Each data point is like a rain drop. When you have a documentation process in place, you can get to the point where you know it’s raining and intuit how much rain is falling. It is Analytics that provides you with the information to decide whether or not you need an umbrella.

Using Analytics to Generate Actionable Insight

In this context, analytics refers to both the approaches and the software that can process massive amounts of varying data types within set parameters (provided by a user) to uncover patterns – achieving a level of insight that would be prohibitively difficult to do without the assistance of a computer. Law enforcement has used analytics to explore tactics to advance the efficacy of policing. This is only possible because of the data created by officers, both digital and not. At this level, an agency is just asking its officers to do paperwork. Necessary, no doubt, if only to have a chain of documents to audit. But agencies could be using this information to help officers get better at their jobs.

For the individual officer, analytics can guide continuous growth and improvement. How you measure this progress will depend on what standards your agency implements, but generally speaking, observable “growth and improvement” is any behavior that moves an officer up and to the right from whatever baseline expectations you set for them. If data indicates an officer is more likely to use force during third watches, you might consider evaluating them for sleep hygiene or avoid assigning them to third watch. It could be this individual is less likely to de-escalate when their natural sleep patterns are disrupted. Or maybe additional training paired with mindfulness coaching could be part of the solution. Instead of policy-driven management – which operates on whether an officer is following the rules or not – we can use data analysis to understand what behavior, coupled with training, leads to the best overall outcomes for an officer and the community.

This is similar to the type of ongoing growth we expect from other industries. Doctors are evaluated by their outcomes as well as subjective factors like bedside manner and perceived empathy. The same could be said for teachers, who receive regular evaluations from students and have access to myriad professional development opportunities. There is a distinct difference between an average doctor and an exceptional one; a teacher with room for improvement, and one voted Teacher of the Year.

Beyond certification for weapon and tactical systems, officers grow and improve throughout their careers. Officers are continuously refining their approach to interacting with the civilian population and each other. Yet this process of improvement is often independent of explicit agency guidance. Officers grow (or not) on their own, absent the same type of regular feedback and guidance from supervisors typically considered table stakes in other professions.

How can supervisors use data to help officers improve?

We can apply analytics to four areas of law enforcement: understanding what types of people tend to be exceptional police officers; identifying an agency’s best officers to help supervisors develop models for professional development; gauging the impact of trauma exposure on officers; and identifying and addressing behavior patterns that are likely to precede adverse events with civilians.

Policing is a difficult job. Successful officers project empathy and power simultaneously while responding appropriately to rapidly evolving situations. In the same way everyone isn’t built to play professional football or achieve Grandmaster status in chess, not every person is wired to be an officer. In theory, anyone can throw a football well or recognize opportunities on a chessboard – some just come by these skills more naturally.

Over time, we can begin to understand why certain individuals get things wrong and how others can learn from it. The stakes are undoubtedly high: mistakes can put an individual officer at risk as well as members of the community. Yet through the use of data, agencies can provide tailored, outcome-specific feedback to individual officers based on their own unique profile so they can improve.

To get these results, agencies have to familiarize themselves with the limitations of certain types of data processing. It’s a step in the right direction whenever an agency implements a process for objective self-evaluation. However, some methods for using data to manage officers that were once thought to be effective are no longer reliable sources of insight.

Beyond trigger-based personnel management

A primary example of using data more effectively to manage and support officers is the use of early warning systems. Since the 1970’s, agencies implemented early warning systems to flag officers acting outside a predetermined norm. Supervisors configured the system’s “triggers” using a blend of experience and intuition. Research has shown this approach is ineffective: trigger-based systems fail to correctly identify off-track officers. Further, they focus solely on what not to do rather than what officers could be doing to improve.

Data Science empowers us to move beyond these simple mechanics. Instead of intuition, we can use insight generated through rigorous analysis of longitudinal data. This enables an agency to provide tailored management to its officers. This leads to more effective policing and by extension a safer, and engaged, community.

What Data to Consider when Evaluating a New Officer’s Performance

Posted on June 14, 2019July 22, 2019 by Bob Tulini

You can think about officer performance evaluation from three different, though equally important, perspectives. First, an officer’s performance is evaluated by field training officers (FTOs) based on how well they apply academy techniques to real-world scenarios as new recruits.

Continue reading “What Data to Consider when Evaluating a New Officer’s Performance”

How to Develop Goals for Your In-Service Learning Management System

Posted on March 14, 2019August 5, 2020 by Bob Tulini

Training doesn’t have a sterling record in the business world. Studies have found that after one hour, people forget more than 50% of a lesson.

This isn’t necessarily new information, either. In the 19th century, German Psychologist, Hermann Ebbinghaus, published research demonstrating “The Forgetting Curve.” He found that humans forget 40% of what they learn within 20 minutes.

After 9 hours, we’ve forgotten about 64%.

And yet we continue to train because we continue to uncover new approaches and new skills that can be critical to influencing how we work. The act of training itself isn’t falling short as much as the tools we use to deliver and reinforce it.

Organizations use Learning Management Systems (LMS) to provide training to their employees at scale. This software is often deployed using a Software-as-a-service (SaaS), or online training, model. Which means you and your team can access the software in the field, at your desk, or at home, without losing momentum.

Know What You Want from Your LMS

Before transitioning to a new LMS, or choosing one for the first time, it’s important to articulate exactly what you hope to get from it. SMART is a helpful framework for goal-setting that’s probably familiar. SMART stands for Specific, Measurable, Relevant, and Time-Bound.

For example, a SMART goal could be:

100% of patrol officers will have completed the revised Use of Force training by May 12, 2019.
By 2021, new de-escalation training will reduce citizen complaints by 25%

If you find you can’t execute against your goals with your current system, work with your team to find out why. Is it due to software limitations or something else? This will help you identify which features will be most important to your team should you choose to implement a new or different LMS.

What to Ask Before You Start Goal-Setting

Once you’ve decided to pursue an LMS, create a rubric to guide your decision making. It should reflect your goals for the system, as well as any internal or external mandates your agency must comply with.

Support the certification of your officers

Certification is a critical part of an officer’s career. For better or worse, many advances in technology entail a certification process: breathalyzers, TASERS, firearms. The list goes on. This can make staying compliant feel like a full-time job, a responsibility that’s only exacerbated by outdated tools like desktop spreadsheets. An LMS can automate much of this process, thus reducing your overall department risk of under-delivering on training (and increasing your exposure to liability) while improving the training experience for your officers. Leveraging this automation lets you comfortably co-exist with the complexity of maintaining certifications across your entire department.

Reduce the burden of data management (literally…and figuratively)

Binders are no one’s friend. Especially when you’re trying to deliver crucial training in use of force or active shooters. Using an LMS lets you deliver courses to your team through a centralized digital classroom that’s easily maintained by your trainers. This enables your department to stay nimble in understanding how to respond to emerging threats while maintaining best practices in other areas.

Confidently review status updates on the progress of officer training

When a salesperson misunderstands or fails to adopt tactics from a coaching session, the worst-case scenario is some prospect enduring a bad pitch. For police officers, the consequences are high-stakes. Using an LMS provides your leadership team with a single view into training adoption and progress. This is especially useful during accreditation processes like the one offered by CALEA, or when maintaining training standards mandated by the state or POST.

Minimize your department’s exposure to risk

If an officer’s performance is ever scrutinized by a third-party external to your department, the last thing you want is gaps in training data (or people data in general). An LMS allows you to easily generate documentation that shows a holistic view of the your officer’s training history, which you can refine to only include data relevant to the case in question. This ease of reporting extends to any request for officer records like those solicited under FOIA.

Provide your officers with the tools to continuously hone and learn important skills

Perhaps most important, an LMS provides the digital infrastructure your officers need to perform at their best. It also provides you with the insight you need to shape future training goals based on performance or knowledge gaps that reveal themselves through your department’s data.

Which Features Support Your Goals?

Once you have the goals for your LMS documented, you can start to identify which features and functionally you’ll need to support them. Here are some examples of options you’ll encounter:

Tracking adoption and training activity
Reporting on compliance and officer performance
Integrations with other technology you use to track Use of Force, Community Engagement activities, as well as performance evaluation
SCORM (Sharable Content Object Reference Model) Compliance, which is a content development standard used by training providers; this is especially important if you rely on a lot of third-party content for training
User interface (how does it look to your learners and trainers, and how easy is it to use?)

As you think about your current training resources and how you’d like to see them evolve in the coming years, consider whether or not they can support SMART goals to the same degree an LMS can. If not, it’s likely time to consider a new solution.

Tips for Assessing Your Professional Standards and Early Intervention Systems

Posted on March 15, 2018December 2, 2019 by Bob Tulini

Have you ever taken a self-assessment exercise? Often times the first thing you’re told is that there are no right or wrong answers – the objective is to become more aware of the totality of characteristics that comprise your identity. Makes sense, right? But unfortunately, that same principle does not apply to organizational self-assessment – there are right answers and there are definitely wrong answers.

Consider, for example, your current police force management provider. Are you getting the most technologically advanced solution possible? It should be fully automated and configurable to your specific needs. That includes meeting the specific polices of your agency, as well as your collective bargaining agreement. Also, is it scalable to integrate with other systems as needed – and holistic to provide you with the most visibility possible on your officer activity?

And what about your early intervention system? Is it preventative by nature – or does it feel like you’re always playing catch up? The true value of a professional standards solution should be to allow you to get ahead of issues before they become real problems . . . proactive vs. reactive, if you will. That means being able to intervene on off-track behavior before careers are jeopardized and issues are escalated to community and media exposure.

Something else to ask yourself – what role does research and analytics play in your police force management and early intervention systems? We know that across almost all professions and industries, evidence-based research and advanced analytics play a major role in human capital management. The same should be said for law enforcement, where we need the most reliable and actionable information possible to make informed decisions related to both on-track and off-track behavior.

These are just a few examples of things you should be considering, but you get the idea. Self-assessment can be easy when you know the right questions to ask. If you’re not sure, do a little bit of research – the information you need is out there.

You can also click here to take a quick, 6-question online assessment from Benchmark. Or, download the full assessment, compiled from our years of real-world policing experience, best-in-class technology expertise, as well as research and analytics background.