Project Management

eDiscovery Project Management: Train the Team — Agenda

 

Training for a task should be thorough and aimed at teaching the team what they need to know to do the work correctly and efficiently.  It should cover project overview information, procedures for doing the work, and sample work.  Here’s a sample training agenda for a document review project that you can use as a guide:

Case Background Information

  • A description of the parties
  • A description of the events that led to the case
  • A description of the allegations and defenses
  • An overview of the expected case schedule

Project Overview

  • A description of the goals of the document review project
  • A description of the process
  • An overview of the expected project schedule

Responsive Criteria

  • Go through the criteria – point by point – to ensure the group understands what is responsive and what is privileged
  • Provide samples of documents that are responsive and documents that are not responsive

Mechanics

  • Describe the roles of individuals on the team (reviewers, quality control staff, supervisors, project managers, etc.)
  • Review the procedures for the review
  • Train the team how to use the online review tool

Samples

  • Have the team do some sample work and turn it in
  • Review the sample work and go over it as a group

The first items on the agenda  — case background and project overview information — are very important.  While they don’t directly cover the mechanics of the work the team will be doing, these topics are significant for motivating the team.   The team will “invest” more in the project if they understand the big picture and how the work they are doing fits in.  In fact, it’s always a good idea to have a senior litigation team member participate in the overview portion of the training.  This further emphasizes the importance of the work the team will be doing.

What do you think?  Have you seen the difference good training can make on a project? Do you have useful training tips to offer?  Please share your comments or let us know if you’d like more information on a topic.

eDiscovery Project Management: Train the Team — Preparation

 

As critical as procedures are, they aren’t enough.  People need to be trained in applying those procedures.  Training the staff will get your project off to a good start.

Training is especially important for tasks that require a team of people to do the work – for example, a document review project.  When a team is doing the work, train them together as a group if that’s possible.  That way, different interpretations of the rules will likely surface and team members will benefit from the questions of others.

Training should cover project overview information and a review and explanation of the procedures for doing the work.  If there’s a subjective component to the work, review the subject matter outline or criteria.  Have the team do sample work, review it right away, and go over it as a group.

Let me give you a more detailed training plan and outline, using training for a document review project as an example.

Prepare a Project Manual

As a starting point, prepare a manual for each team member.  Include this information in the manual:

  • Case Documents, such as the complaint and request for production;
  • The Document Review Criteria, which provides guidelines for determining responsiveness and privilege;
  • A List of Custodians with information about each such as his/her position in the organization, a description of his/her role in the events that are at issue, and the types of documents you expect will be found in the custodian’s files;
  • Lists of Keywords, Key Characters, Key Events and Key Dates;
  • The Review Procedures;
  • The Review Schedule;
  • Instructions for Resolving Questions;
  • Instructions for Use of the Review Tool.

You’ll use this manual as the basis for the training, and in addition it will be a useful resource for each team member throughout the project.

Tomorrow I’ll give you a sample training agenda that you can use as a guide for your own training sessions.

What do you think?  Have you seen the difference good training can make on a project? Do you have useful training tips to offer?  Please share your comments or let us know if you’d like more information on a topic.

eDiscovery Project Management: Assign the Right People

Last week, on Wednesday and Thursday, we talked about assembling an electronic discovery team.  That’s not the only team you might need.  You may need to assemble a team for a specific task — for example, for a document review.

It’s essential that you assign the right type of people to a task.  For many litigation projects, this means deciding whether attorneys or non-attorneys will do the work.

Pushing the work up to over-qualified people can be just as problematic as using under-qualified people.   I’ve seen first hand how important this is.  I once worked on two large cases simultaneously where millions of documents had to be reviewed in each case.  In one case, I convinced the client that paralegals could handle the bulk of the work.  In the other case, the client insisted that only lawyers could do the work.

I don’t have to tell you how much more the second client paid for the work.  You may be surprised, however, by the quality comparison.  Each project involved multiple law firms, and one firm was involved in both.  That firm did quality control on both projects, and found that there was significantly less re-work required in the project where paralegals did most of the work.

Why?  We gave the paralegals objective criteria that didn’t require a law degree to understand, and they were far more attentive to work that made the lawyer’s eyes glaze over.  The lawyers — who were responsible for making decisions, answering questions, and reviewing work — were able to stay attentive to the more substantive work.

This is where breaking a task into components can help.  Here’s an example.  Everyone knows that determining privilege is an attorney task.  That doesn’t mean, however, that only attorneys can work on the project.  In every collection there are types of documents that will never be privileged unless they bear privileged annotations (published materials, annual reports, case-specific documents like routine manufacturing and quality control reports, etc.).  A trained paralegal using good criteria can do an initial review to identify potentially privileged documents for attorney review.

A project handled like this will certainly cost less, and will probably result in more consistent, higher quality work.

Have you worked on projects where the wrong people did the work?  Please share your comments or let us know if you’d like more information on a topic.

eDiscovery Project Management: Finding the Right People for Your Team

Yesterday, we talked about the skill sets and areas of expertise that are required to effectively handle an electronic discovery project.  Those skills and expertise are diverse and you won’t find everything you need in a single person.  You need to put together a team.  So, where do you find the right people for your team?    Most likely your team can be made up of individuals from these sources:

Law Firm Personnel

  • Partners, associates and paralegals working on the case will have knowledge of the facts at issue and the strategy for using documents.  They will know what documents are responsive, privileged, significant, helpful and harmful.  They will also have knowledge of the litigation process and the rules of civil procedure.  Paralegals are also likely to have a very good handle on the document collection as the case moves forward.
  • Law firm litigation/practice support and technical staff will have knowledge of the electronic discovery process, electronic discovery tools and electronic discovery service providers.  They also may have skills in collecting forensically sound data.  And, litigation support professionals will have project management skills.

Client Personnel

  • Members of the corporate legal department will have knowledge of the issues in the case, the case strategy and goals, the documents, and the business operations and key characters at issue.
  • Corporate IT and records management personnel will have knowledge of the computer systems in use at the client’s offices, knowledge of document retention, computer use, backup and disaster recovery policies and practices, and how and where documents are stored and accessed.
  • Client personnel who are familiar with the business units, facts and events that are at issue in the case, and the relevant documents that are likely to exist.

External Resources

Depending on what tasks need to be done and on what computing resources /expertise you require, you may need to add electronic discovery consultants, service providers, and forensics experts to your team.  You may not need to involve them right away.  You might get the rest of the team in place and have the team determine what external resources are needed.  If, however, you are inexperienced with electronic discovery, involving a consultant early can be invaluable.

What do you think?  Who do you include on your electronic discovery teams?  Please share your comments and let us know if you’d like more information on a particular topic.

eDiscovery Project Management: Assemble the Right Team

 

There are lots of tasks associated with a large electronic discovery project.  A number of skill sets and areas of expertise are required to do them all well.  It’s not likely that all of those skills and knowledge will reside in a single person.  You need to create the right electronic discovery team to ensure that there are no glitches.

Under a common case scenario that involves collecting electronic discovery, processing, analyzing/culling, review, and production, you should have all of these areas covered:

  • Knowledge of electronic discovery:  Knowledge of the process, technology tools, and service providers.
  • Technical knowledge and skills:  Skills in collecting forensically sound and defensible data and knowledge of your client’s technology systems and practices.
  • Knowledge of your client’s document policies and practices:  Knowledge of document retention policies and practices and knowledge of what types of files exist and how and where they are stored and accessed.
  • Knowledge of the facts at issue in the case, and the strategy for using documents in the case:  You need someone who can make decisions on what document content is responsive, privileged, significant, helpful, and harmful.
  • Familiarity with the cast of characters and knowledge of who is likely to have documents and knowledge about what.
  • Knowledge of the litigation process and the rules of civil procedure that apply to electronic discovery.
  • Expertise in search technology, techniques and strategies.
  • Project management skills and experience.

It is critical that a project manager is identified early on.  There are lots of steps in the process that will require continuous oversight and monitoring.  The project manager will be responsible for creating project plans, creating budgets and schedules, identifying required resources, ensuring that decisions are made by the right people, ensuring that deadlines are met, and so on.  On a case with a large electronic discovery collection and a short schedule, this is a full-time job.

Tomorrow, we’ll talk about what types of people are likely to have the right skill sets, and then we’ll move on to assembling the right team for a specific task that requires significant numbers of people.

What do you think?  Who do you include on your electronic discovery teams?  Please share your comments and let us know if you’d like more information on a particular topic.

Reporting from the EDRM Mid-Year Meeting

 

Launched in May 2005, the Electronic Discovery Reference Model (EDRM) Project was created to address the lack of standards and guidelines in the electronic discovery market.  Now, in its sixth year of operation, EDRM has become the gold standard for…well…standards in eDiscovery.  Most references to the eDiscovery industry these days refer to the EDRM model as a representation of the eDiscovery life cycle.

At the first meeting in May 2005, there were 35 attendees, according to Tom Gelbmann of Gelbmann & Associates, co-founder of EDRM along with George Socha of Socha Consulting LLC.  Check out the preliminary first draft of the EDRM diagram – it has evolved a bit!  Most participants were eDiscovery providers and, according to Gelbmann, they asked “Do you really expect us all to work together?”  The answer was “yes”, and the question hasn’t been asked again.  Today, there are over 300 members from 81 participating organizations including eDiscovery providers, law firms and corporations (as well as some individual participants).

This week, the EDRM Mid-Year meeting is taking place in St. Paul, MN.  Twice a year, in May and October, eDiscovery professionals who are EDRM members meet to continue the process of working together on various standards projects.  EDRM has eight currently active projects, as follows:

  • Data Set: provides industry-standard, reference data sets of electronically stored information (ESI) and software files that can be used to test various aspects of eDiscovery software and services,
  • Evergreen: ensures that EDRM remains current, practical and relevant and educates about how to make effective use of the Model,
  • Information Management Reference Model (IMRM): provides a common, practical, flexible framework to help organizations develop and implement effective and actionable information management programs,
  • Jobs: develops a framework for evaluating pre-discovery and discovery personnel needs or issues,
  • Metrics: provides an effective means of measuring the time, money and volumes associated with eDiscovery activities,
  • Model Code of Conduct: evaluates and defines acceptable boundaries of ethical business practices within the eDiscovery service industry,
  • Search: provides a framework for defining and managing various aspects of Search as applied to eDiscovery workflow,
  • XML: provides a standard format for e-discovery data exchange between parties and systems, reducing the time and risk involved with data exchange.

This is my fourth year participating in the EDRM Metrics project and it has been exciting to see several accomplishments made by the group, including creation of a code schema for measuring activities across the EDRM phases, glossary definitions of those codes and tools to track early data assessment, collection and review activities.  Today, we made significant progress in developing survey questions designed to gather and provide typical metrics experienced by eDiscovery legal teams in today’s environment.

So, what do you think?  Has EDRM impacted how you manage eDiscovery?  If so, how?  Please share any comments you might have or if you’d like to know more about a particular topic.

eDiscovery Project Management: Tips for Creating Effective Procedures

Yesterday, we talked about why written procedures are important in eDiscovery and the types of procedures you should be writing.  Today I’m going to give you some tips for creating effective procedures.

First, let me say that writing procedures is easy.  In fact, it’s probably the easiest writing task you’ll ever do.  You don’t need to be creative.  You don’t need to develop an elegant writing style. In fact, the best procedures are simple and to the point.  All that’s required to write good procedures is knowledge of how to do the task and some guidelines.  Here are the guidelines:

  • When possible break a task down into its subcomponents and draft procedures for each sub-component.  It’s likely that different parts of a task may be handled by different people and done at different times.  Each component, therefore, should have its own set of procedures.  For example, your procedures for collecting responsive data may have components for notifying custodians, interviewing custodians, copying the data, maintaining records, and preparing and transporting media.
  • Use simple, clear language.  Keep sentences short and simple.  Use simple words.  If you are writing instructions to be used by attorneys, avoid using technical terms and acronyms with which they may not be familiar.
  • Make the procedures detailed.  Assume your reader doesn’t know anything about the task.
  • Make sure the steps are well organized and in the right order.
  • Format the procedures so that they are easy to read.  Use bullets, numbered points, and outline formats.  It’s much easier to follow instructions that are clearly laid out in steps than it is to follow procedures written in paragraphs.  This, incidentally, makes it easier to write procedures.  You don’t need to worry about the flow of sentences or paragraphs.  You just really need to put together a set of clear bullet points.
  • When possible, use illustrations:  If you are providing instructions for using a technology tool, include screenshots, and mark up those screen shots with annotations such as arrows and circles to emphasize the instructions.

It’s always a good idea to test your procedures before you apply them.  Ask someone who hasn’t done the task before to apply the procedures to a sample of the work.  Holes in the procedures will surface quickly.

So, what do you think?  Do you have any good tips for drafting procedures in eDiscovery?  Please share any comments you might have or tell us if you’d like to know more about a particular topic.

eDiscovery Project Management: The Importance of Good Written Procedures

 

Even for simple eDiscovery tasks, good written procedures are critical.  They will:

  • Ensure that everyone doing the work understands the task.
  • Cut down or eliminate inconsistencies in the work product.
  • Cut down or eliminate the need for re-work.
  • Foster efficiencies that will help prevent cost over-runs and missed deadlines.
  • Eliminate time spent “reinventing the wheel” each time a task is done.

Written procedures are a good idea for all tasks, but they are especially important for work done by multiple people.  Often procedures are overlooked for simple tasks.  It’s easy to feel comfortable that everyone will do a simple task well.  The problem is that it’s very easy for two people to interpret a task differently.  When you have a large group of people working on a task – for example, a group doing a review of an electronic document collection – the potential for inconsistent work is enormous.

Let me give you some examples of the types of procedures you should be creating:

  • Procedures for gathering potentially responsive documents from your client:  These procedures should include instructions for notifying custodians, for interviewing custodians, for the tools that are to be used, for the types of copies that are to be made, for the storage media to be used, for keeping records of the collection effort, and for delivering data for subsequent processing.
  • Procedures for a document review:  These procedures should include clear, objective criteria for responsiveness and privilege, instructions for using the review tool, instructions for retrieving batches of documents to review, and instructions for resolving questions.

In a perfect world, you would have detailed, written procedures for all of the tasks that you do yourself, and for all of the tasks done by those who report to you.  Unfortunately, most organizations aren’t there yet.  If you don’t have a complete set of procedures yet, create them whenever a task is at hand.  Over time, you will build a library of procedures for the tasks that you handle.  Procedures are not hard to write.  Tomorrow I’ll give you some tips that will serve as a guideline for creating effective procedures.

So, what do you think?  Have you worked on eDiscovery projects where written procedures would have helped?  Please share any comments you might have or tell us if you’d like to know more about a particular topic.

eDiscovery Project Management: Data Gathering Plan, Schedule Collection

We’ve already covered the first step of the data gathering plan:  preparing a list of data sources of potentially relevant materials and identifying custodians.  Now let’s fill out the plan.  Here’s a step-by-step approach:

  • Determine who will gather the data.  You need an experienced computer expert who has specialized tools that collect data in a way that preserves its integrity and who can testify – if needed – regarding the processes and tools that were used.
  • For each data source on your list, identify where the data is located.  You should interview custodians to find out what computers, storage devices, communications devices and third party service providers they use.
  • For each data source on your list, identify what type of data exists.  You should interview custodians to find out what software programs they use to generate documents and the types of files they receive.  This list will get filled out further as you start looking at data, but getting this information early will give you a good feel for what to expect and will also give you a heads up on what may be required for processing and reviewing data.
  • Next, put together a schedule for the collection effort.  Determine the order in which data will be collected and assign dates to each data source.  Work with your client to build a schedule that causes minimal disruption to business operations.
  • Notify custodians in advance of when you’ll be working with their data and what you’ll need from them.

Once your schedule is in place, you’ll be able to start planning and scheduling subsequent tasks such as processing the data.

In our next eDiscovery Project Management blog, we’ll talk about documented procedures.  We’ll cover why they are important and I’ll give you some tips for preparing effective procedures.

So, what do you think?  What do you include in your data gathering plans?  Please share any comments you might have or tell us if you’d like to know more about a particular topic.

eDiscovery Project Management: Data Gathering Plan, Identify Data Sources

 

One of the first electronic discovery tasks you’ll do for a case is to collect potentially responsive electronic documents from your client.  Before you start that collection effort, you should prepare a data-gathering plan to ensure that you are covering all the bases.  That plan should identify the locations from which data will be collected, who will collect the data, and a schedule for the collection effort.

Learn about Your Client

First, you need information from your client that is aimed at identifying all the possible locations and custodians of responsive data.  Some of this information may be available in written form, and some is best gleaned by interviewing client employees.   

Start by looking at:

  • Organization charts to identify potential custodians.
  • Organization charts for the IT and Records Management departments so you’ll know what individuals have knowledge of the technology that is used and how and where data is stored.
  • Written policies on computer use, back-ups, record-retention, disaster recovery, and so on.

To identify all locations of potentially relevant data, interview client employees to find out about:

  • The computer systems that are used, including hardware, software, operating systems and email programs.
  • Central databases and central electronic filing systems.
  • Devices and secondary computers that are used by employees.
  • Methods that employees use for communicating including cell phones, instant messaging, and social networking.
  • Legacy programs and how and where legacy data is stored.
  • What happens to the email and documents of employees that have left the organization.
  • Third party providers that store company information.

Once you’ve done your homework and learned what you can from your client, compile a list of data sources of potentially relevant materials.  To compile that list, you should get input from:

  • Attorneys who are familiar with the issues in the case and the rules of civil procedure.
  • Technical staff who understand how data is accessed and how and where data is stored
  • Records management staff who are familiar with the organization’s record retention policies
  • Client representatives who are experts in the subject matter of the litigation and familiar with the operations and business units at issue. 

Once you’ve got your list of data sources, you’re ready to put together the data-gathering plan. 

So, what do you think?  Do you routinely prepare a data-gathering plan?  Have you had problems when you didn’t?  Please share any comments you might have or tell us if you’d like to know more about a particular topic.