Skip to content

[FEATURE] Allow EC on Keep, and delay profile from create, effectively allowing for hot, warm and cold tiers #677

Open
@edrock200

Description

@edrock200

Have you read through available documentation, open Github issues and Github Ideas Discussions?

Yes

System information

Your moosefs version and its origin (moosefs.com, packaged by distro, built from source, ...).

MFS version: 4.57.6-1 ; build: 1944

Operating system (distribution) and kernel version.

Ubuntu 24.04 stock kernel

Hardware / network configuration, and underlying filesystems on master, chunkservers, and clients.

10G, mixed amd64/x86 hosts with ssds and platters

How much data is tracked by moosefs master (order of magnitude)?

  • All fs objects: ~15m
  • Total space: 2.3pb
  • Free space: 2.1pb
  • RAM used: 10G
  • last metadata save duration: 1h

Describe your request:

What new feature would you like to see implemented in MooseFS?

Primarily looking for a delay profile between create and keep. Would be nice to be able to use ec on keep as well.

Why this feature? Is it a necessity or a nice to have? Is this feature related to any other features or problems in the open issues?

This would effectively allow for hot, warm and cold tiers. For example today I write 2 copies to ssd's, then archive to platters as EC. But it would be nice to for example go from 2x ssds create for 2d, then to EC ssds keep for 5 days, then to EC on platters for archive. EC on Create/keep isn't as important but would be a nice to have. In that scenario I could still do 2 copies SSD create for 2d, 3 copies keep on platters 5d, then EC on platters for archive.

Appreciate the consideration.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions