Skip to main content

Command line tool to search and delete duplicate files – FDupes

Years passing, the amount of data in my server have kept growing and unfortunately, for several reasons, I’m having a lot of duplicates (Old copy of some documents, redownload of a file as I’ve “lost” it and even some accidental copy/paste,…). But no way to check one by one by myself!

And this is where FDupes came.

FDupes is a small command line tool to help you find duplicate files and if wanted, to delete all the copies. It uses MD5Sum to compare all the files on your selected device and has a wide set of options (Recursive, scan only files above a minimum size, can delete for you, etc…)


Very easy to use and install as you can see:

1) Install FDupes (From your distribution repo)

2) Start a scan (Recursive but no delete at this point)

It will scan and list all the duplicate file you have in your targeted device/folder:

It can takes quite a long time if used on large disk/folder (10mn for me on a full 1TB drive) but here is an example of result:

Easy right? Perfect for my server.

However you still have to be a bit careful…for example some files are exactly the same, but you want to keep them as it is….

I have a lot of creative commons musics in my server and every folder got a licence.txt file. Sometimes, it’s the same licence file for different album or author, but I still want to keep all of these files right where they are.

So it’s still good to double check before deleting them. If you don’t care, you can simply add the option -d to fdupes and it will delete them.

working efficiency minimum wage

Securely and anonymously share a file – OnionShare

If you are looking for a way to securely and anonymously share a file, the best way is probably to use TOR.

Configuring Tor, then adding a FTP service or so could take some time tho.

Well, not with OnionShare!

OnionShare let you share a file of any size in a secure and anonymously way with sometone. Written in Python, it works by launching a web server on your computer (No need to have a working server in that case) making it accessible as a Tor hidden service. It will generate an unguessable URL to download the file.

You will host the file on your own computer directly to be shared as a Tor hidden service.

The other people receiving the file just needs to use the Tor Browser to download the file (Or directly install Tor on its machine too).onionshare screenshotOnionShare is already available in Tails OS by the way.Compatible with MacOS and GNU/Linux system (Windows to come soon), you will first need to install Tor or use the Tor Browser so that OnionShare can use the Tor server provided in there.Let’s see how to install it.


1) First install TorIn root, type:

(or just launch Tor Browser)2) Clone their git repository on your computer

3) Run the with the file you want to share.

It will generate an URL for you to share to your contact. Obviously, you will need to share it securely too (Like with Jabber+OTR, or Email+GPG)

4) When downloaded, you can stop the server by pressing CTRL+C

Modern & Web based TOP command for your server – Scout Realtime

Did you know that the TOP command (to display a lot of useful realtime information to monitor your server, home computer, etc… such as CPU usage, memory usage, disk usage, processes, etc…) was born 30 years ago?

top screenshotTop has been one of the command I’ve learnt first for my GNU/Linux system (most probably 10 Years ago)

Well I recently discovered Scout Realtime, an intuitive and redesigned TOP command type for your server but web based.

Usually we don’t have much realtime monitoring tool with web interface. I’m using munin to monitor my server but it’s not realtime (but has other strengths)

Scout Realtime have obviously improved what TOP is reporting.
– They have a very smooth scrolling with charts updated every second,
– They got easy to read trends with some historical data,
– They have added the disk and network activity
– They have updated the way to calculate the free ram (They have counted the buffer ram that could be used when needed)
– And finally, they have grouped processes together but no jumping in and out as we have with TOP. It fixed and then easy to read the trends.

Written in Ruby, the installation is very simple. You only need to install Ruby then the package and you’re good to go!

Scout Realtime - Screenshot

It’s still in active development and works great out of the box. But if you want to change a bit the default configuration (add HTTP login, change port, etc…) you will need to wait a next release.



1) Install Ruby

2) Install Scout Realtime

3) Start Scout Realtime

4) Simply go to http://YourIP:5555

You may now want to access to Scout Realtime instance through a subdomain instead of typing your IP and the port. Also by binding the connection to port 80 (or 443), you may have less trouble with proxies too.


Virtualhost configuration

To do that, you will need to create a dedicated virtualhost and use ProxyPass and ProxyPassReverse option to access to your service from the port 5555 to the port 80.

You will obviously need a A redirection from top.domain.tld to your IP, in your DNS config (Registrar?)

1) Install Apache mod proxy html

2) Activate the mod-proxy-http (Already installed)

3) Create a dedicated vhost in /etc/apache2/site-enabled/ called scoutrealtime with:

4) Reload Apache

You should now have access to your Scout Realtime instance on top.yourdomain.tld

Syncloud – Personal online storage for your Raspberry Pi

syncloudIf you are looking for a cheap NAS or a simple server to store and access your files, you most probably know Owncould, a simple, yet powerful hostable file management app, that you could directly install on a Raspberry PI, the credit-card sized computer at 35USD.

But the Syncloud team have build a dedicated Linux version that already contains Owncloud for a very easy and fast deployment.

Syncloud also support the BeagleBone Black and the Cubieboard A10.

Simply download the image file, uncompress it and write the image on your SD card. Then turn in on and you’re good to go!

OpenSource image hosting scripts for your own server

Following my review on some popular RSS Readers, I’ve decided to do the same for image hosting services, similar to TinyPic, ImageShack, etc… type, but to be installed on your own server.

A lot of public websites exist, but you don’t really know what they do with your pictures and personal info (IP, websites linked to, content of the picture, day and hours posted, etc…). If you got your own server, installing a similar service is usually very easy and some of them have very good additional features as you will read below.

Here is the current list I found. I will obviously try and write articles on them as soon as I can!  \o/, (under GPL v3), drag & drop type with encryption from the web browser before the upload, no log, firefox extension for quick upload, command line upload feature, etc…

chevereto, nice design, drag&drop upload or from URL, explore and search features, responsive design, with social media sharings, and many more. Once my favourite one, but now oriented for professionals with licence fee. (The old version is still available tho and an article to help you install it is now available!!)

MediaCrush, easy to use (Ctrl+v to upload a link or picture), few options, …

Pix, from the french association Toile-libre, very simple one with limited options

Jirafeau, a fork of the old Jyraphe, still KISS oriented (Keep It Simple Stupid). Not only for pictures but any type of file.

Lutim, encrypted at server side, URL upload, delete at first view, and many more options,…

Not many….I’ll keep updating this article when I found new ones. If you know some interesting others opensource image hosting script, please share in the comments section!