100 to 1 Compressor

[clive]

heh, this guys funny, be gentle with him.

Indeed, I've got some data with pretty much zero entropy, any attempt to compress it will make it bigger, and possibly annoy it.

-Clive

[oex]

I wonder how much more efficient the web could be

[dedndave]

with that pic, his full name must be Clive A. Anderson   :P

[oex]

You hear that Mr. Anderson?... That is the sound of inevitability entropy...  :lol

I believe white noise is entropic? but why is it white?

[Gunner]

If you can do what you say you can do, I am sure I can get some backers and buy it from you for a couple of mil!  Would make that back in no time!

[hutch--]

Sergiu,

This claim sounds like something out of fantasyland. You are talking to experienced programmers here. You can in fact come close if you have a gigabyte of identical characters and you run a variety of RLE but for random binary or similar data forget it.

[Eddy]

Data, encrypted with AES (or any other good encryption algorithm) does not compress at all ....

Kind regards

[Sergiu FUNIERU]

You are talking to experienced programmers here.

I've never said otherwise. I have no intention to insult anyone with what I say.

for random binary or similar data forget it.

In my opinion, we got used too much to the idea that the algorithms we use today can compress the data to the lowest limit.

I will take a pause from posting on this particular thread until my program will be ready, so I can offer a live demo. I've done before things that others told me that can't be done. When they saw the demo, they said "Oh, I've never thought of that".

My ex-boss is a very experienced professional, with more than 20 years of experience in that particular field. Working for so long, he had optimized to the limit the algorithms he learned in school. What I brought new was a fresh point of view. I'm sure that if the situation were reversed, he would have came with the fresh point of view. On a real life comparison, he was closed to the world record on running from point A to point B. I simply took the bus from point A to point B. Does that mean that I was smarter than him? No. It means that I didn't want to accept they were no other better ways to do a certain task, and I looked around for alternative solutions. He ceased to do that long ago, because  he was was confident that the algorithms he used can't be optimized any more. And he was right - THOSE algorithms couldn't be optimized any more.

[sinsi]

So you can compress a zip/rar/jpg/gif/7z at 100:1 eh?

[Sergiu FUNIERU]

Data, encrypted with AES (or any other good encryption algorithm) does not compress at all

May I ask you for a favor? Could you, please, send me PM with a sample of data that can't be compressed at all? I'm not ironical. I don't know how to make this sound like it should - I'm really interested in such a sample.

[oex]

You dont need encrypted data to prove the point, any full color photo you can compress over jpg compression losslessly

eg http://www.masterspring.com/Images/compression2_6110(kn2862).jpg

[dedndave]

Sergiu
practically any RAR or 7z file is pretty well compressed already
usually, attempting to compress an already compressed file again results in a larger file or, at least, no further compression
the same is true of the other formats, but these two are likely the most "tightly" compressed

[Eddy]

Could you, please, send me PM with a sample of data that can't be compressed at all? I'm really interested in such a sample.

Sure. How long would you like the file to be? I am not sure what the max file length is that can be sent via PM. Otherwise, if you PM me your e-mail, I will send via e-mail.
(or I can also use a file sharing service. I'll see)

Kind regards

[Eddy]

Could you, please, send me PM with a sample of data that can't be compressed at all?

Sergiu,
I have generated a file of about 100kB long. I used a Blum-Blum-Shub PRNG rather than AES, because I have software readily available to do that. This data should be uncompressable. Winzip and 7zip can't compress it for example.
The file (BBS.txt) can be downloaded here (max 100 downloads over the next 7 days):
https://www.yousendit.com/download/RmNDTG0rUzczMWxFQlE9PQ

Kind regards

[Slugsnack]

Just to confirm, when you say 'any file'. Do you mean you could continually compress a given file that had already been previously compressed with your algo ?