I’m currently debating on how to manage files on my servers. I have a jellyfin and a minecraft server on which I need to add, remove or download files quite often. I don’t really want to use scp for everything, so I was wondering what everyone uses.
Edit: I’m looking for a gui solution, but a somewhat automated process of backups etc. is also nice
Edit 2: For anyone wondering what my final solution was: I am currently using a wireguard vpn on a raspberry pi to access my servers. I use Xpipe as a gui interface to transfer my files. I also just use tmux and ssh to execute commands and run services.
You must log in or register to comment.
Linux?
I just use sshfs to mount ssh shares and move files between them like any other folder.
Same with samba shares (windows).
Sftp using the KDE file browser Dolphin. Keeps it simple for my monkey brain as if I’m accessing the drive locally.
IDK what OS you are on but on Linux most file managers have support for remote filesystems. SFTP (SSH-FTP, not to be confused with FTPS which is FTP-secure) is ubiquitous and if you use
scpthen you already have SSH set up.If you need Windows support it is more of a pain. You may need to set up Samba or WebDAV and permissions can suck. But you can also download a third-party file browser that supports remote protocols.
So basically SFTP, and I fairly regularly just use a graphical file manager when I am doing one-off operations.
I’m using debian, so sftp would be an option, do you use a graphical client?
nemo for a gui, or midnightcommander after logging in via ssh for managing/moving files on the server.
Right now I am just using nautilus (default GNOME file manager) but in past I was using Thunar (default XFCE file manager). I’d be pretty surprised if whatever file manager you are currently using doesn’t support SFTP out of the box. Typically you can just enter something like
sftp://myhost.exampleinto the location bar. They may also have a dedicated network connection section with a wizard to add it.
Can you tell us what’s your issue with scp? It’ll help us make better recommendations.
I mostly want some sort of graphical way, I’m often moving a bunch of loose files and seeing them is a lot easier for me when transferring
I would recommend you mention “graphical” or “GUI” in your main post. Most suggestions to be assuming CLI.
Some suggestions mentioned NFS / SSHFS. Those would allow you to use any GUI file manager for moving stuff over.
Sorry I can’t help more. Don’t have a lot of knowledge in gui tools
will do, thanks a lot
sftp://USERNAME@SERVER:PORTin the address bar of most file managers will work. You can omit the port if it’s the default (22), you can omit the username if it’s the same as your local user.You can also add the server as a favorite/shortcut in your file manager sidebar (it works at least in Thunar and Nautilus). Or you can edit
~/.config/gtk-3.0/bookmarksdirectly:file:///some/local/directory file:///some/other/directory sftp://my.example.org/home/myuser my.example.org sftp://my.example.net:2222/home/otheruser my.example.netHow exactly are you “losing” files?
I’m not losing them, I have a lot of single files. For example during a Minecraft update, I have to move ~20 jar files and other things to the server. I also try to make frequent backups and I upload new movies somewhat frequently to my jellyfin server, so I want to have an easy way to transfer files.
Loose, not lose
It’s not very sexy, but I just use SFTP and filezilla. Filezilla is available for all the major operating systems, and an ssh server is basically required anyways.
Plex/Jellyfin is automatically managed by Sonarr/Radarr so I don’t touch those.
But for game servers I use Pterodactyl which has a nice WebUI to manage the server and its files, and has automated backups.
pterodactyl looks really neat, will definitely look into that. I have a manual system for my media library, so I want to add the directories with artwork and movies manually to the directory which jellyfin reads.
https://github.com/filebrowser/filebrowser might be what you want for that, just a basic web based file management tool.
But you could also just use SMB and access the shares directly from file explorer.
NFS comes to mind, naturally.
I remember some years ago scp had a big issue, can’t recall what, though. But that made me have a look at rsync, and I’ve been using that ever since. Flags are a bit atteocious, but I’ve aliases
rsync -avz status=progresstocopyand it’s been happy days. One other benefit - incremental copy. Helps in cases where a copy procedure had been stopped for whatever reason.Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:
Fewer Letters More Letters DNS Domain Name Service/System HTTP Hypertext Transfer Protocol, the Web Plex Brand of media server package SSH Secure Shell for remote terminal access SSL Secure Sockets Layer, for transparent encryption TLS Transport Layer Security, supersedes SSL VPN Virtual Private Network
7 acronyms in this thread; the most compressed thread commented on today has 6 acronyms.
[Thread #576 for this sub, first seen 5th Mar 2024, 18:25] [FAQ] [Full list] [Contact] [Source code]
NFS, SMB, and/or sshfs
- NFS for my media shares between servers (Emby, MPD, etc)
- SMB for accessing from workstations
- sshfs when I need a quick, one-off file session (or if I’m accessing remotely)
Sshfs is also a good candidate if for whatever reason you want security / encryption
I mostly want to upload to a media server from my desktop, as that is where I download and manage the files before they go on the server
Use Filezilla and SFTP.
rsync for backups. SMB / NFS for things I need on a daily basis. SSH FTP (use whatever client you want) for things I need rarely but don’t wanna bother with SCP and I especially don’t bother ever bother setting up vsftpd for ‘real’ FTP.
Being the weirdo I am I have 2 things I use.
WinSCP to get that classic FTP look of file transfers and VS Code when working on smaller compose files.
I tend to use rsync 99% times.
how would you do that with a large media library?
I would just use rsync on the whole folder.
Rsync is smart enough to be able to only send files you didnt’ have previously like a regular mv command.
Or you can sync the whole directory and have it also delete removed files.
I’m now considering syncing my minecraft world with syncthing, I already use it for some things but don’t know why I didn’t think of doing that.
On the other hand, if I have a 100+ gb media library, it seems kinda over the top to also have it fully copied on my local machine. Do you do this?
When it comes to media like my music library and comics for example I just use rsync to move new ones to the server every time I collect some new (I have about 60gb of it)
so you basically have a copy of your media library on a local machine?
No, I only have new files on my local machine, and as I collect new stuff I move them to my server with rsync and just remove it onthe local machine.
Rsync is more than smart enough to, if you keep same folder structure to easilly move the files to the server without you having to manually copy other each file.
sounds good, do you have any docs on how to do that?
deleted by creator
ftpanssftpare completely different things.ftpis a very old protocol and can be run encrypted asftps.sftpruns over SSH and is pretty common to use.Naming is truly one of the hardest problems in computer science.
Thanks😅. I wasn’t aware, and until today thought that sftp is just like “the secure version of ftp” (never heard of ftps), and not different things at all. I have still a lot to learn in this field.
Edit:I deleted the comentarios because i am unsure on what i am using right now and i don’t want to confuse people. I’ll check it when i have some free time
what! thats so dumb xD. so
ftpsstands for file transfer protocol secure, andsftpstands forssh file transfer protocol? we have reached recursive acronyms.
SCP?
sorry, should’ve clarified: secure copy, it’s an ssh kind of way of copying files to a server
Yeah, I had to look it up but the above was the first search result 🙂
I use samba for normal usage and rsync for backups.
Do you automate your backups in some way? And can you also use samba remotely
For automatic stuff I use synching to keep my home an documents in sync.
I don’t normally use samba remotely but I have a wire guard VPN that I connect to if I’m not at home and that gives me access to samba or any other “local” services I might need when away
