e-Discovery Team Training
Sec. 3 – Mod. IStudy at you own time, your own place, your own pace.
Welcome to Module 3-I.
The Proportionality Game: “Small, Medium or Large?”
Proportionality is the most important concept in e-discovery law. In this class we will explore proportionality, and, at the same time, provide the big picture of all of the activities that need to be done to prepare for a Rule 26(f) Conference on e-discovery. This will not be an easy class, so to make the medicine a bit more palatable, we present this information here as a game in the form of thirty-two multiple choice polls at the end. Specifically, we will ask students to decide which activities are appropriate for federal court 26(f) conferences in small and medium sized cases, versus large, complicated cases? Small, Medium or Large? is kind of a Goldilocks game of proportionality.
Background To Play the Game
In order to play the Small, Medium or Large? game, you first need to be familiar with the checklist of the Southern District Court of Florida of all of the things that you should do to prepare for e-discovery in a large case. The Court’s checklist incorporates the new provisions in the rules on relevance and proportionality (Rule 26(b)(1)) and on specific objections (Rule 34(b)(2)).
We begin by reproduction below of the Court’s checklist itself in somewhat altered form. We have not revised any of the words in the checklist, but have added numbers not found in the original to facilitate discussion. So it is fair to say our revisions are not of actual content, but of metadata only. We also add after each item a personal comment, put in parenthesis, italicized and in blue font, so as to be very clear on what is ours and what is not.
If you want to see the original, bullet points and all, the PDF version of the Checklist and Rules are published on the Court’s web. Go to the end of the document (currently pages 78-79) to find the ESI Checklist.
United States District Court
Southern District of FloridaChecklist for Rule 26(f) Conference
Regarding Electronically Stored Information (“ESI”)
(Original Bullet Points Changed to numbers and Comments put in parenthesis after each list item, are shown in italics and blue font)In connection with the Federal Rule of Civil Procedure 26(f) conference and in preparing the Local Rule 16.1(b)(2) conference report, the Court encourages the use of the following checklist. The usefulness of any particular topic may depend on the nature and complexity of the matter.
Preservation
1. The ranges of creation or receipt dates for any ESI to be preserved. (In almost every case there is a date before which the ESI is not relevant. In many there is also an after date. Disagreement between parties on date range should be resolved by phased discovery and reservation of rights to object after first phase is completed.)
2. The description of ESI from sources that are not reasonably accessible because of undue burden or cost and that will not be reviewed for responsiveness or produced, but that will be preserved in accordance with Federal Rule of Civil Procedure 26(b)(2)(B). (Backup ESI is almost always so protected, unless it has the only copy of important information.)
3. The description of ESI from sources that: (a) the party believes could contain relevant information; but (b) has determined, under the proportionality factors, is not discoverable and should not be preserved. (The keyword here is “could.” Maybe it has relevant information, maybe it does not. Also important in determining discoverability under governing proportionaity rules is the “importance” of the information to material issues of fact in dispute. You must consider probative value. In my experience with big data most “merely relevant” information is a waste of time. There is too little probative value to most of it to even try to capture it all.)
4. Whether to continue any interdiction of any document-destruction program, such as ongoing erasures of e-mails, voicemails, and other electronically recorded material. (Typically the key custodians identified should have their email auto-delete functions turned off, and voice mail, but as to them only, not the whole enterprise. Plus, I cannot recall voice mail ever making a difference in a case. It typically has low probative value.)
5. The number and names or general job titles or descriptions of custodians for whom ESI will be preserved (e.g., “HR head,” “scientist,” “marketing manager”). (This is the broad list of key custodians. They are often divided in classes by probable importance of their ESI to the outcome of the case. Although all classes may be preserved, only the most important are actually reviewed, at least at first.)
6. The list of systems, if any, that contain ESI not associated with individual custodians and that will be preserved, such as enterprise databases. (A list not associated with custodians usually refers to department type servers where a number of people in the department could store documents, to document management systems, or to general databases, such as payroll.)
7. Any disputes related to scope or manner of preservation. (You should get these issues resolved asap. Typically you would want to preserve until the issue is resolved, unless the expense is too great or the other side’s position is too unreasonable. But even then you run some risk, and so quick adjudication on issues like this are important.)
Liaison
8. The identity of each party’s e-discovery liaison, who will be knowledgeable about and responsible for each party’s ESI. (Losey always like to see the role and name that he invented back in 2006 – “e-discovery liaison” – used by a court. One of his first e-Discovery “Liaisons” is now a U.S. Magistrate Judge in the Southern District, and a very good one at that, especially in e-discovery.)
Informal Discovery About Location and Types of Systems
9. Identification of systems from which discovery will be prioritized (e.g., e-mail, finance, HR systems). (Typically the communications between people, the contemporaneous writings, are the ESI with the highest probative value.)
10. Descriptions and location of systems in which potentially discoverable information is stored. (Typically this means a description of all IT systems where relevant ESI might be stored, and not just the high value targets like communications. Document management systems and network drives might also be listed here.)
11. How potentially discoverable information is stored. (This is a follow-up on the prior checklist item that describes how the ESI is stored. Usually it is stored manually at the discretion of listed custodians. They either save the documents or email or not. Where they save it may also be within their control. They may save it on personal thumb drives, or they may print it out to store. You have to interview the custodians to find out how they stored it. Sometimes the potentially discoverable information is stored automatically by other software systems, such as payroll systems, and sometimes the location is predetermined.)
12. How discoverable information can be collected from systems and media in which it is stored. (Usually it is collected by copying. That needs to be done carefully so that metadata is not changed. Not hard to do, but IT expertise is usually required to do it correctly. Forensic collection is usually not necessary, especially collection of double-deleted files and unallocated space, as such ESI is usually protected under 26(b)(2)(B).)
Proportionality and Costs
13. The amount and nature of the claims being made by either party. (The monetary value should not be exaggerated by plaintiffs, but usually they feel the need to do so for posturing purposes and other reasons. Suggest this impediment be avoided by disclaimers and reservation of rights. Beyond amount issues, the “nature” of the claims should be carefully understood and discussed with an aim to identifying the actual disputed facts. Discovery should always be focused and have evidentiary value. It is never an end in itself, or at least should not be. Also, do not forget that subject matter discovery is no longer permitted under revised Rule 26(b)(1). It is now limited to claims and defenses that have actually been raised in the case.)
14. The nature and scope of burdens associated with the proposed preservation and discovery of ESI. (Try to include actual monetary burden expected, usually with a range, but restrain the urge to exaggerate. Spend time to do this right and get into some detailed metrics. Consult an expert where necessary, but never b.s. the judge. They do not like that and will remember you.)
15. The likely benefit of the proposed discovery. (The requesting party should spell it out. Fishing expeditions are not permitted. The old “reasonably calculated” jargon is gone from new Rule 26(b)(1), at least as a definition of scope, and that change voids a lot of case-law on the subject.)
16. Costs that the parties will share to reduce overall discovery expenses, such as the use of a common electronic-discovery vendor or a shared document repository, or other cost saving measures. (In my experience this is very rare, Typically it only makes sense in very big cases and or between co-defendants or co-plaintiffs. There are usually too many confidentiality issues to share a vendor with opposing parties.)
17. Limits on the scope of preservation or other cost-saving measures. (Cost savings should always be considered. This is required of all parties, attorneys and judges under the 2015 revision to Rule 1, FRCP. So too is “speedy” and “just.”)
18. Whether there is relevant ESI that will not be preserved in accordance with Federal Rule of Civil Procedure 26(b)(1), requiring discovery to be proportionate to the needs of the case. (Typically the answer here is yes, or should be, and some discussion may be required. Preservation is required by law to be reasonable, not exhaustive or perfect. Reasonable means proportionate. Moreover, if ESI is not relevant under the proportionate definitions of revised Rule 26(b)(1) then it does not have to be preserved because only relevant ESI need be preserved.)
Search
19. The search method(s), including specific words or phrases or other methodology, that will be used to identify discoverable ESI and filter out ESI that is not subject to discovery. (Please students, exchanging keywords should be just the beginning, not the whole process. It is only one of many possible search methods. Use the Hybrid Multimodal method, which all readers of my blog and books should know pretty well by now.)
20. The quality-control method(s) the producing party will use to evaluate whether a production is missing relevant ESI or contains substantial amounts of irrelevant ESI. (The problem of missing relevant ESI is the problem of Recall, whereas the problem of too much irrelevant ESI is the problem of Precision, but also, to some extent, to the problem of duplication. All good electronic document review experts have a number of different quality control techniques to improve recall and precision. Not an expert? Then perhaps you should consult with one in your firm, or if you have none (pity), then ask your e-discovery vendor.)
Phasing
21. Whether it is appropriate to conduct discovery of ESI in phases. (Yes. It is a great way to resolve disagreements by postponing excessive demands for second or third phases. Chances are these other phases will not be necessary because all that is needed is produced in the first phase. Alternatively, the producing party might agree to them if the first production makes their necessity obvious.)
22. Sources of ESI most likely to contain discoverable information and that will be included in the first phases of Federal Rule of Civil Procedure 34 document discovery. (Here is where the producing party lists what sources they will search, most often communication ESI such as Outlook Exchange email servers.)
23. Sources of ESI less likely to contain discoverable information from which discovery will be postponed or not reviewed. (These are sources that are unlikely to have ESI with strong probative value, if any, but might. There may never be a need to review these sources. As a compromise where there is disagreement put these sources in a later phase. After the first phase is completed it may not be necessary to look for more evidence in these secondary sources.)
24. Custodians (by name or role) most likely to have discoverable information and whose ESI will be included in the first phases of document discovery. (Here is where you list the key custodians. In most lawsuits all you will ever need to search is the contents of the mailboxes of these key witnesses, the emails, attachments, calendar items, etc in their email system.)
25. Custodians (by name or role) less likely to have discoverable information from whom discovery of ESI will be postponed or avoided. (These are secondary custodians that might possibly have important information, but it is less likely. Typically, if you cannot revolve disagreements on importance, you agree to postpone the disputed custodians to second phases.)
26. The time period during which discoverable information was most likely to have been created or received. (Again, limit the review by timing and if you cannot agree, then postpone disputed additional times for second phases.)
Production
27. The formats in which structured ESI (database, collaboration sites, etc.) will be produced. (Typically database production is done by spreadsheet reports, or sometimes native. The person in charge of the structured ESI should know.)
28. The formats in which unstructured ESI (e-mail, presentations, word processing, etc.) will be produced. (Producing parties should follow the requesting parties format request most of the time, except if they ask for paper production. Paper production is ridiculous and expensive for ESI. Otherwise format should not matter. It is, or should be, a non-issue.)
29. The extent, if any, to which metadata will be produced and the fields of metadata to be produced. (A non-issue too. If metadata is part of the document, then produce it. Your vendor can give you a standard list.)
30. The production format(s) that ensure(s) that any inherent searchability of ESI is not degraded when produced. (This is a must. In my court it can be sanctionable to change an electronic document so that it is no longer searchable.)
Privilege
31. How any production of privileged or work-product protected information will be handled. (Of course you do not produce it, but you log it.)
32. Whether the parties can agree on alternative ways to identify documents withheld on the grounds of privilege or work product to reduce the burdens of such identification. (Look for ways to streamline your privilege log. For instance, under other Southern District local rule you never have to log communications made after suit was filed.)
33. Whether the parties will enter into a Federal Rule of Evidence 502(d) stipulation and order that addresses inadvertent or agreed production. (You should always have a 502(d) Order whenever you are making an electronic production. Mistakes happen and this is the closest thing we have in the law to a fail-safe. There is no valid reason to oppose this order. Clear enough for you?)
It is not a perfect list, but it is the best one now out there with a court pedigree. It is not too long and complex, like the older lists of some courts that are very detailed, and not too short, like the easy-peasy list that Bill Hamilton and Ralph Losey created for the Middle District Court of Florida many years ago. (Attorneys still complained about how burdensome it was!) In sum, the 33-Point Checklist out of Miami is a good list for legal practitioners all over the country to use to prepare for e-discovery, which means it is a good basis for our Small, Medium or Large? game. Come play along.
Rules of the Game
The goal of our Proportionality Game is to determine which of the thirty-three points on the checklist are applicable to big cases only, which are applicable to medium size cases and which to small cases. You are to assume that all thirty-three points apply to large cases, but that they are not all applicable to medium and small size cases. The voting is used to allow to identify which of the thirty-three only apply to small cases, and which only apply to medium size cases. If a checklist item applies to a medium size case, it automatically also applies to a small size case.
In other words, the game is to sort the thirty-three into three piles, Small, Medium or Large? Simple, eh? Well, maybe not. This is a matter of opinion and things are pretty vague. For instance, we are not going to define the difference between large, small and medium size case.
The game is important because proportionality in the law is important. You do not prepare for a big case the same way you prepare for a small case. You just don’t. You could, but it would be a waste of your clients money to do so. So the real trick in e-discovery, like in all other aspects of the litigation, is to determine what you should do in any size case to prepare, including even the small cases. For instance, outside of e-discovery, most people would agree that you should take the parties depositions as a minimum to prepare for a trial of any size case, including small ones.
What are the equivalent items in the 33-point checklist? Which of them should be applied to all cases, even the small ones? Which of them are too complicated and expensive to apply in a small case, but not a medium sized case? Which too complicated and expensive to apply in a small or medium sized case, but not a large one? That is where the real skill and knowledge come in. That is the essence of the game.
Assume All 33 Items Apply to Big Cases
Again, this Small, Medium or Large? Game requires you to assume that all thirty-three items on the Court’s checklist apply to big cases, but not to all cases, that there are certain checklist items that only apply to medium size cases, and others, a smaller list, that only apply to small cases. You may question the reality of this assumption. After all, the Court does not say that. It does not say, here’s a checklist we made to guide your e-discovery, but you can ignore many of the items on this list if you have a small case, or even a medium size case. Still, that’s what they mean, but they do not go on to say what’s what. They know that the Bar will figure it out themselves in due time, meaning the next several years. And right they are. But why wait? Let’s figure it out ourselves now with this Small, Medium or Large? Game, and condense years to weeks.
The Game will allow us to fill in the blanks of what the Court did not say. But first, lets focus again on what the Court did say. It said that the checklist may be used by members of the Bar to guide the Rule 26(f) e-discovery conferences and Case Management Reports. It did not say shall be used. It is a suggestion, not a requirement. Still, as every long-term member of the court knows, what they mean is that you damn well should follow the checklist in a big case! Woe unto the lawyers who come before the judges in a big case with an e-discovery issue where they never even bothered to go through the checklist. If your issue is on that list, and chances are it will be, then dear slacker, prepare for a Miami style bench-slap. Ouch! It is going to hurt. Not only you and your reputation, but also your client.
I feel confident in making the game assumption that all thirty-three checklist items apply to big cases. I am also confident they do not all apply to medium and small size cases and that is the real reason for the court’s use of may instead of shall.
With that background we are almost ready to start playing the game and opine away as to which of the 33 are small and medium size only. But, there is still one more thing I have found very helpful when you try to really dig into the checklist and play the game, you need to have the numbers 1-33 added to the list. The one mistake the Court made on this list was in using headings and bullet points instead of numbers. I fix that in the list that follows, so that you can, if nothing else, more easily play the game. Here is a summary, with some slight editing to wording and our comments removed.
Preservation
Liaison
Informal Discovery About Location and Types of Systems
Proportionality and Costs
Search
Phasing
Production
Privilege
One Example Before the Games Begin
We are almost ready to play the e-Discovery Small, Medium or Large? Game. We will do so with thirty-two polls that are presented to the player in the same order as the Court’s checklist. To make sure the rules are clear (this is, after all, a game for lawyers, not kids) we start with an example, the first of the thirty-three items on the checklist. The court’s first item is to suggest that you Determine the range of creation or receipt dates for any ESI to be preserved.
The “right answer” to this first item is that this should be done in every case, even the small ones. You should always determine the date range of data to be preserved. In most cases that is very easy to do, and, as every lawyer should know, when in doubt, when it comes to preservation, always err on the side of inclusion. That means you should check the Small Case answer as shown in the “dummy poll” graphic below.
Checklist 1
We have set these polls up so that you cannot see the results, but you can leave private comments. We may do this again later and experiment with what happens when you can see the results. We will share the results (and some comments) when the game ends on January 1, 2019.
Now for the live polls and game proper. Note that several of the checklist items, including number two and three, which are the first two polls shown below, are so long that we had to paraphrase and shorten them to fit in the space allocated in the polling software.
So get ready to plug-in. Select an answer to each of the thirty-two polls that follow. After you vote, you also have a chance to leave a private comment to each poll, but that is optional and will not impact your score.
Checklist 2
Checklist 3
________________________________________
Checklist 4
Checklist 5
Checklist 6
Checklist 7
Checklist 8
________________________________________
Checklist 9
________________________________________
Checklist 10
________________________________________
Checklist 11
________________________________________
Checklist 12
________________________________________
Checklist 13
________________________________________
Checklist 14
________________________________________
Checklist 15
________________________________________
Checklist 16
________________________________________
Checklist 17
________________________________________
Checklist 18
________________________________________
Checklist 19
________________________________________
Checklist 20
________________________________________
Checklist 21
________________________________________
Checklist 22
________________________________________
Checklist 23
________________________________________
Checklist 24
________________________________________
Checklist 25
________________________________________
Checklist 26
________________________________________
Checklist 27
________________________________________
Checklist 28
________________________________________
Checklist 29
________________________________________
Checklist 30
________________________________________
Checklist 31
________________________________________
Checklist 32
________________________________________
Checklist 33
________________________________________
________________________________________
SUPPLEMENTAL READING: This class is hard enough, so no supplements for this one. If you must, read up on proportionality law.
EXERCISE: Redo the polls sometime, not right away, and see if your answers change.
Students are invited to leave a public comment below. Insights that might help other students are especially welcome. Let’s collaborate!
Copyright Ralph Losey 2017
