I set it to debug at somepoint and forgot maybe? Idk, but why the heck does the default config of the official Docker is to keep all logs, forever, in a single file woth no rotation?

Feels like 101 of log files. Anyway, this explains why my storage recipt grew slowly but unexpectedly.

  • Matt The Horwood@lemmy.horwood.cloud
    link
    fedilink
    English
    arrow-up
    4
    ·
    5 hours ago

    for some helpful config, the below is the logging config I have and logs have never been an issue.

    You can even add 'logfile' => '/some/location/nextcloud.log', to get the logs in a different place

      'logtimezone' => 'UTC',
      'logdateformat' => 'Y-m-d H:i:s',
      'loglevel' => 2,
      'log_rotate_size' => 52428800,
    
  • MonkeMischief@lemmy.today
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 hours ago

    Wow, thanks for the heads up! I use Nextcloud AIO and backups take VERY long. I need to check about those logs!

    Don’t know if I’m just lucky or what, but it’s been working really well for me and takes good care of itself for the most part. I’m a little shocked seeing so many complaints in this thread because elsewhere on the Internet that’s the go-to method.

    • MTK@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 hours ago

      It can be fidgety, especially if you stray from the main instructions, generally I do think it’s okay, but also updates break it a bit every now and again.

    • non_burglar@lemmy.world
      link
      fedilink
      English
      arrow-up
      23
      ·
      14 hours ago

      I don’t disagree that logrotate is a sensible answer here, but making that the responsibility of the user is silly.

      • Shimitar@downonthestreet.eu
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        10
        ·
        7 hours ago

        Are you crazy? I understand that we are used to dumbed down stuff, but come on…

        Rotating logs is in the ABC of any sysadmin, even before backups.

        First, secure your ssh logins, then secure your logs, then your fail2ban then your backups…

        To me, that’s in the basic stuff you must always ensure.

        • MTK@lemmy.worldOP
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          2 hours ago

          This is a docker! If your docker is marketed as ready to go and all-in-one, it should have basic things like that.

          If I were running this as a full system with a user base then of course I would go over everything and make sure it all makes sebse for my needs. But since my needs were just a running nc instance, it would make sense to run a simple docker with mostly default config. If your docker by default has terrible config, then you are missing the point a bit.

          • Shimitar@downonthestreet.eu
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            1 hour ago

            Dockers images are often incoherent and just different from one a other so much that you should never give something as expected and doublecheck the basics.

            Docker was never meant do deploy services, and I shows.

        • Appoxo@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          3 hours ago

          Logration is the abc of the developer.
          Why should I need 3rd party tools to fix the work of the developer??

          • Shimitar@downonthestreet.eu
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            2
            ·
            1 hour ago

            Why is that? Really? The Dev should replace a system function? And implement over and over again the same errors when logrotate exist?

            • acockworkorange@mander.xyz
              link
              fedilink
              English
              arrow-up
              1
              ·
              31 minutes ago

              Yes, that’s exactly what we’re arguing here. The developer also should replace autotools/cmake, git, … Don’t be daft! Packaging sane defaults for logrotate is now replacing a system function?

              • sugar_in_your_tea@sh.itjust.works
                link
                fedilink
                English
                arrow-up
                1
                ·
                14 minutes ago

                Docker is supposed to run a single process Logrotate is a separate process. So unless the application handles rotating logs, the container shouldn’t handle it.

        • catloaf@lemm.ee
          link
          fedilink
          English
          arrow-up
          2
          ·
          6 hours ago

          Those should also all be secure by default. What is this, Windows?

          • Shimitar@downonthestreet.eu
            link
            fedilink
            English
            arrow-up
            2
            ·
            6 hours ago

            Just basic checks I prefer to ensure, not leave to distribution good faith. If all is set, good to go. Otherwise, fix and move on.

            Specially with self hosted stuff that is a bit more custom than the usual.

    • catloaf@lemm.ee
      link
      fedilink
      English
      arrow-up
      29
      ·
      16 hours ago

      We should each not have to configure log rotation for every individual service. That would require identify what and how it logs data in the first place, then implementing a logrotate config. Services should include a reasonable default in logrotate.d as part of their install package.

      • sugar_in_your_tea@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 minute ago

        Docker services should let docker handle it, and the user could then manage it through Docker or forward to some other logging service (syslog, systemd, etc). Processes in containers shouldn’t touch rotation or anything, just log levels and maybe which types of logs go to stdout vs stderr.

      • Shimitar@downonthestreet.eu
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 hours ago

        Agreed, but going container route those nice basic practices are dead.

        And also, being mextcloud a php service, of can’t by definition ship with a logrotate config too, because its never packaged by your repo.

      • RubberElectrons@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        16 hours ago

        Ideally yes, but I’ve had to do this regularly for many services developed both in-house and out of house.

        Solve problems, and maybe share your work if you like, I think we all appreciate it.

  • Neo@lemmy.hacktheplanet.be
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    3
    ·
    18 hours ago

    Imho it’s because docker does away with (abstracts?) many years of sane system administration principles (like managing logfile rotations) that you are used to when you deploy bare metal on a Debian box. It’s a brave new world.

    • Scrubbles@poptalk.scrubbles.tech
      link
      fedilink
      English
      arrow-up
      44
      arrow-down
      1
      ·
      17 hours ago

      It’s because with docker you don’t need to do log files. Logging should be to stdout, and you let the host, orchestration framework, or whoever is running the container so logs however they want to. The container should not be writing log files in the first place, containers should be immutable except for core application logic.

    • poVoq@slrpnk.net
      link
      fedilink
      English
      arrow-up
      5
      ·
      edit-2
      15 hours ago

      Or you can use Podman, which integrates nicely with Systemd and also utilizes all the regular system means to deal with log files and so on.

      • Neo@lemmy.hacktheplanet.be
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 hours ago

        Good suggestion, although I do feel it always comes back to this “many ways to do kind of the same thing” that surrounds the Linux ecosystem. Docker, podman, … some claim it’s better, I hear others say it’s not 100% compatible all the time. My point being more fragmentation.

        • Appoxo@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          2
          ·
          3 hours ago

          100 ways to configure a static ip.
          Why does it need that? At least one per distro controlled by the distro-maintainers.

    • sith@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      edit-2
      5 hours ago

      I stopped using Nextcloud a couple of years ago after it corrupted my encrypted storage. I’m giving it a try again because of political emergency. But we sure need a long term replacement. Written in Rust or some other sane language.

      • MTK@lemmy.worldOP
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 hours ago

        Nc is great, it really is amazing that it is foss. Sure it isn’t the slickest or fastest, and it does need more maintenance than most foss services, but it is also more complex and has so many great features.

        I really recommend nc, 99% of the time it just works for me. It just seems that their docker was done pretty poorly imo, but still it just works most of the time.

    • ikidd@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      11 hours ago

      Just use the official Docker AIO and it is very, very little trouble. It’s by far the easiest way to use Nextcloud and the related services like Collabora and Talk.

  • zoey@lemmy.librebun.com
    link
    fedilink
    English
    arrow-up
    2
    ·
    15 hours ago

    Reminds me of when my Jellyfin container kept growing its log because of something watchtower related. Think it ended up at 100GB before I noticed. Not even debug, just failed updates I think. It’s been a couple of months.

    • MTK@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 hours ago

      Look, defaults are a thing and if your defaults suck then you’ve made a mistake and if your default is to save a 100GB of log file in one file then something is wrong. The default in Dockers should just be not to save any log files on the persistent volumes.

    • Scrubbles@poptalk.scrubbles.tech
      link
      fedilink
      English
      arrow-up
      17
      ·
      17 hours ago

      Persistent storage should never be used for logging in docker. Nextcloud is one of the worst offenders of breaking docker conventions I’ve found, this is just one of the many ways they prove they don’t understand docker.

      Logs should simply be logged to stdout, which will be read by docker or by a logging framework. There should never be “log files” for a container, as it should be immutable, with persistent volumes only being used for configuration or application state.

      • exu@feditown.com
        link
        fedilink
        English
        arrow-up
        7
        ·
        15 hours ago

        The AIO container is so terrible, like, that’s not how you’re supposed to use Docker.
        It’s unclear whether OP was using that or saner community containers, might just be the AIO one.

        • merthyr1831@lemmy.ml
          link
          fedilink
          English
          arrow-up
          6
          ·
          11 hours ago

          It’s too late for me now coz I didnt do my research and ive already migrated over, but good god ever loving fuck was the AIO container the hardest of all my services to set up.

          Firstly, it throws a fit if you don’t set up the filesystem specifically for php and the postgres db as if it were bare metal. Idk how or why every other container I use can deal with UID 568 but Nextcloud demands www-data and netdata users.

          When that’s done, you realise it won’t run background tasks because it expects cron to be set up. You have to set a cronjob that enters the container to run the cron, all to avoid the “recommended” approach of using a second nextcloud instance just to run background tasks.

          And finally, and maybe this is just a fault of TrueNAS’ setup wizard but, I still had to enter the container shell to set up a bunch of basic settings like phone region. come on.

          Straight up worse than installing it bare metal

          • MTK@lemmy.worldOP
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 hours ago

            Yes! When I read that I need a second instance for cron I was like “wtf?” I know NC are not the only ones doing that but still

        • Scrubbles@poptalk.scrubbles.tech
          link
          fedilink
          English
          arrow-up
          7
          ·
          14 hours ago

          I have lost now not hours, but days debugging their terrible AIO container. Live production code stored in persistent volumes. Scattered files around the main drive in seemingly arbitrary locations. Environment variables that are consistently ignored/overrided. It’s probably my number one example of worst docker containers and what not to do when designing your container.

          • ilmagico@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            ·
            13 hours ago

            Yeah, their AIO setup is just bad, the more “traditional” and community supported docker compose files work well, I’ve been using them for years. They’re not perfect, but work well. Nextcloud is not bad per se, but just avoid their AIO docker.

            • grimer@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              10 hours ago

              I’ve only ever used the AIO and it’s the only one of my problem containers out of about 30. Would you mind pointing me to some decent community compose files? Thanks!!