Having just finished reading it, I am intrigued by the report, disagreeing with parts, surprised by others, and in agreement on many points.
The Event
I did end up heading down to D.C. to attend the event. Unfortunately, it took me 2 and a half hours as opposed to the usual hour and 15. I left early, so I only arrived a half hour late, and caught the tail end of the talk and the discussion afterwards. The end of the discussion was unexpectedly civil, so it seems like the talk went over well.
From what I could tell, there were people from the EAC, OVS, TrueVoteMD, the AFB and the Library of Congress. I am sure there were other individuals from prominent groups there as well, the room was pretty full. In particular, I was hoping folks from EPIC and the EFF would be present. My advisor, Alan Sherman, showed up and when Punchscan came up in the discussion he pointed me out as one of the developers.
Unfortunately, the room cleared out quickly, and I did not get to talk to very many people. I was particularly interested to hear from the TrueVoteMD rep, who I sat next too but left as soon as the discussion ended before I could introduce myself. I did talk to one of the EAC commissioners, Rosemary Rodriguez. I also talked with David Webber, of OVS. He, the speaker, Alan, and myself shared interesting conversation over lunch. This made the trip worthwhile.
The Paper
As I said, the paper was intriguing, and I was really all over the place on my thoughts/opinions. Overall, I think it has the right intent but it has a perspective that a lot of people (particularly activists) are not going to like. At it’s core, the document promotes universally verifiable end-to-end cryptographic technologies, but i’m not sure if that message is going to get through given the title and first half of the report. I will start by pointing out the surprising bits, then what I like, and end with what I dislike about the paper.
What Surprised Me
On Page 9, it opposes a federal open source code mandate but supports use of open source by the states, and it specifically quotes “security through obscurity” as the reason:
Although Congress should not mandate the disclosure of proprietary source code, states and counties would be wise to show preference to voting system manufacturers that publicly release the source code of their products for review. “Security through obscurity” has long been derided as an ineffective safeguard against attackers. The security of the voting machine should not depend on the confidentiality of the machine source code. Voting systems with publicly released source code will undergo greater scrutiny and testing by security researchers than those that are only tested in government-approved laboratories. Furthermore, voters will have a higher level of confidence in elections conducted on these machines given their greater degree of transparency.
The author provides existing alternatives to paper audit trails: the audio ballot, IV machine, and single-input-dual-output. Granted, I am not fond of any of these methods, but it does show that he has done his homework. You can find them on Page 10.
There are examples of fraud w/ a paper trail. He talked about the LBJ voting fraud scandal, and the switch to lever machines. Most people never do this when they talk about paper trails, just saying that they are bad, but he justifies it:
The integrity of a paper ballot still depends on physical security controls. Historically, failed security controls have led to modified, spoiled, and stolen ballots, as well as to stuffed ballot boxes.
What I Liked
I really liked that he spent a few pages explaining many of the cryptographic primitives that are used by E2E voting systems. These primitives are difficult to comprehend and I think he did a decent job in explaining them. You can find them in Box 1 and 2 on pages 12 and 13. I also liked that he talked about some example systems (VoteHere and Scratch&Vote).
He provided an excellent explanation of the core problem in securing elections on Page 9, one which I have not seen before:
The real problem with the current generation of DRE voting machines is not that they use computers, but that the integrity of the election depends on maintaining a secure chain-of-custody of the voting machines and the ballots. This problem is not unique to DRE voting machines, because the integrity of the election in a paper ballot system is similarly dependent on a secure chain-of-custody. In either voting system, a ballot can be compromised only if malicious actors are able to insert themselves into the voting process by, for instance, stuffing a ballot box or changing the code in a DRE voting machine.
He excellently characterized the difference between VVPAT and similar methods from those of E2E (which he terms local verifiability and universal verifiability):
Unlike local verifiability, universal verifiability allows voters to be completely confident in the validity of the final election results.
And also this quote:
Ultimately, voters want to know that their vote was included in the final tally. Paper audit trails do not provide this assurance.
I think the core premise of the paper was well thought out. It doesn’t seem to me that he’s discounting paper trails so much as saying that thinking they are going to solve all our problems is misguided, and pointing out that E2E, or universally verifiable systems as he calls him, are a good alternative. The caveat to this is that the beginning is set up to solely be an attack on paper trails. I have a feeling that many individuals will not bother reading the whole paper.
Dislikes
The paper does not make a concerted effort to differentiate between current DREs and the E2E approach, and I think that is very confusing. E2E is an entirely different approach to the way the software is built, and it feels a bit dirty to equate it with DREs. In fact, the article discounts many of the issues with DREs. When talking about the Top-to-Bottom review in CA, he says the following:
While the report serves as a valuable tool to evaluate and improve the security of these machines, the so-called “attacks” detailed in the report are inconsequential. While these attacks may work in the lab, most of these attacks are unrealistic in real-world election conditions. As the authors admit early on in the report, they made no assumptions about the “compensating controls or procedural mitigation measures that vendors, the Secretary of State, or individual counties may have adopted.” Moreover, the authors acknowledge that the “testers did not evaluate the likelihood of any attack being feasible.”
The quotes he raises are true, but as i’ve said before, it was better that they did it that way. You have to use that report, and take a look at your procedures to see if you are really protecting yourself or not. Having looked at many, many reports on this stuff, there’s quite a few problems with DREs out there where I don’t think you could employ effective procedures to protect yourself. I strongly disagree with the author on this point. That said, he does talk about parallel testing, but my understanding is that very few states use it effectively.
On a minor note, the paper makes the argument that people trust computers to do lots of important things. I would have liked to of seen a section talking about how voting machines should go through more extensive testing, similar to what those other important things go through.
The other thing I strongly disliked was how the paper attacked the opposition to DREs. The paper starts off by calling the whole group technophobic, and thats not true. The sad thing is that many people who disagree are going to do the same thing — wondering who’s pocket ITIF is in and other similar attacks. In my eyes when people do that, they lose credibility. What is important is what they have to say, not their affiliation, funding, or where they are from.
Lastly, and this is obvious: I dislike that he didn’t talk about our system. 
Any-who, I encourage you all to read the report and make your own decision. I’ve already seen some disappointing commentary from Computer World which basically misses the point. There is a piece from ars technica that harps on how the paper attacks the opposition. It also makes this bizarre assertion that paper trail has different vulnerabilities than an all paper system, and seems to mistake the receipts provided by E2E systems as a paper trail. Lastly, and this is surprising, Ed Felten and crew have commented on the article, and they also appear to miss the point.