Lyonite Tested · a measurement series
What PDF tools actually do with your file
Online file tools ask you to take a lot on trust. That your document is deleted after an hour. That it never left your device. That the metadata is gone. Almost none of it is checkable from the outside, and almost nobody checks.
So we check. Merging, splitting, compressing, converting, cleaning — each report takes one claim, puts every tool through the same file, and publishes that file so you can get your own number. Our tools are in the tables too. The first report is the one that caught a bug in ours.
Reports
Each one states when it was measured, because these are live services that change.
How these are done
Four rules, and why each one is there.
Pick a claim with an answer
Not “is this any good”. Did the file leave your device? Did the text survive? How much bigger did it get, and how long did it take? Every report starts from a question a stopwatch, a network panel or a byte count can settle.
Give every tool the same file
One input, built for the job and published with the report. Comparing tools on files they each chose is how you get a table where everybody wins.
Read what the tool claims first
A tool that says it clears the author field and clears the author field is working, however narrow that is. Judging it against a standard it never set makes a report easy to dismiss, and rightly so.
Include ourselves, and date the losses
We build some of the tools we test. Ours go in the same table as everyone else’s, and where we lost, the report says so with a date.
The method for the first report, including why the two obvious ways of checking a cleaned PDF both under-report, is written up in how we test. The corpus lives in its own repository.
What we measure
Four questions, asked of every tool in the category — merging and compressing as much as cleaning. Each report takes one of them and answers it for one kind of tool.
Did the document leave the device at all?
Watch the network while the tool runs. A tool that says “processed in your browser” either makes no request carrying the file, or it does. There is no middle answer.
Did it do the specific thing it says it does?
Build an input where the answer is checkable — planted values for a cleaner, a known outline and form fields for a merger, extractable text for a compressor — then read the output back and count what survived.
What did you quietly lose?
Compare in to out. Bookmarks, internal links, form fields, selectable text, accessibility tagging. The failure that matters here is the silent one: the file opens fine and something inside it is gone.
Did it take longer or come back bigger than it needed to?
Time the same file through each tool, upload and queue included, and measure the output. A “compressor” that returns a larger file, or a merger that doubles the page count in bytes, is a real and common result.
In progress
What is being measured next. If you want one of these sooner, or have a claim worth checking, say so.
These sites say your upload is deleted after an hour. Is it?
Which tools that claim local processing actually do it?
Does “compress” quietly turn your text into a picture of text?
Do bookmarks, links, form fields and tagging survive being merged?
Who publishes this
The questions you should be asking of any comparison, answered about this one.
- Who runs it
- The people who build Lyonite’s PDF tools. Which is the conflict of interest, so: we are in the tables, and where we lost, the report says so with a date.
- What it runs on
- Files built so the answer is checkable, and a script that fails loudly when it is not. Public, one dependency, no account. Clone it and run it.
- How often
- Every published report is re-run and re-dated. A tool that fixes what we found gets a correction with its own date — that update is the story we most want to publish.
- What we get out of it
- You reading this. We sell nothing, there is no account, and every tool is free with no cap. The tables are also how we find our own bugs, which is how the first one started.
Why we run these
Lyonite exists because of the gap these reports keep finding. The thorough answer to "do this to my document properly" has been a paid desktop subscription, and the free alternatives tend to do the visible half of the job and describe it as the whole thing.
We have not tested the paid tools, so we are not going to tell you how we compare to them — on this series' own rules, an untested claim is worth nothing no matter which direction it points. What we can tell you is what we measured. On the seven things the first report checks, we now remove all of them, and we do it in a browser tab, for free, without your file leaving the device. That is the whole offer: the thorough result, without the subscription and without the upload.
And the part that matters more than any table: you should not have to take our word for any of it. Every tool here runs on your device, the code that proves nothing is uploaded is in the repository, and the tests we grade ourselves against are public and include the runs we failed. Not trust us more than them — check us in ways you cannot check them.
If you check and we come up short, we would rather hear it than not. Write to hello@lyonite.com and you will get an answer within 48 hours. Findings get added, with the date and the credit on them. We listen — that is the only reason any of this is worth reading.
Check this yourself. If we got it wrong, tell us.
Every number here came from files you can download and a checker you can run, so you do not have to believe us — clone the corpus and get your own result.
If it disagrees with ours, or if you build one of the tools named here and we measured it unfairly, out of date, or with a setting you would not have used, send it to hello@lyonite.com.
We reply within 48 hours. If you are right, the page is corrected with the date on it and your correction credited, and the old number stays visible so the change is legible. If a tool has since been fixed, that is the update we most want to publish. Nothing here is worth defending past the point it stops being true.