Object Removal LoRA of Flux Fill Dev v2

Update 20250503

Released v2 for object removal

Using new training method, select training objective by timestep, 700

Trained on subset of RORD dataset

Dataset around 500

epoch 3

repeat 1

rank 16

lr 1e-4

The last image in demo example is experimental and it introduces artifacts. So, the 700 reg 0.5 is deprecated.

Update 20240320

Released v1 for object removal

About this version

Trained with larger dataset.

Merged with additional inpaint training to improve details texture.

Known Issue:

Due to the training dataset mostly is to remove human, when removing part of human,

the model would tends to remove the human part from the image.

It is better to use original fill to accomplish this type of removal.

Update 20250316

Upload a more trained file.

It seems longer training improve the generalization.

Update 20250314
Adding random selection training for beta.
It ranfom selects noised factual or noised ground true to train.
It is able to prevent the model degradation due to mis-aligned training objective.

Trainer:

https://github.com/lrzjason/T2ITrainer

Dataset:

lrzjason/ObjectRemovalFluxFill

You could download the lora from huggingface without waiting. This EA is only to support me for further more open source development

https://huggingface.co/lrzjason/ObjectRemovalFluxFill

Model Description

This is an Object Removal LoRA fine-tuned from Flux Fill Dev model.

The lora is designed to remove objects from specified masked areas, making it useful for image editing tasks where unwanted objects need to be erased seamlessly.

This lora is inspired by Object Drop. Object Drop achieved amazing result on removing objects and I want to try it with Flux fill model.

Due to the computing power limitation, this alpha version only trained on very small dataset.

If anyone interested in and want to sponsor the computing power, please contact me.

Intended Use

This model is intended for non-commercial use only, as per the FLUX.1 [dev] Non-Commercial License.

Limitations

Non-Commercial Use Only: This model is restricted to non-commercial applications. Any commercial use is prohibited under the FLUX.1 [dev] Non-Commercial License.

Large Masked Area: The model may struggle with large masked area.

How to Use

To use this model, you need to provide an image and a corresponding mask indicating the area where the object should be removed. The model will then generate an edited image with the object removed.

Using Flux Fill as base model and load the lora.

Training Data

The model was fine-tuned on a small dataset of images with corresponding masks, focusing on object removal tasks. The dataset includes various objects and scenes to ensure robust performance.

License

This model is licensed under the [FLUX.1 [dev] Non-Commercial License](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md). You are free to use, modify, and distribute the model for non-commercial purposes. Commercial use is strictly prohibited.

Citation

If you use this model in your research or projects, please cite it as follows:

```

bibtex

@misc{object-removal-lora,

author = {lrzjason},

title = {Object Removal LoRA of Flux Fill Dev},

year = {2025}

}

```

Contact

Twitter: [@Lrzjason](https://twitter.com/Lrzjason)

Email: [email protected]

QQ Group: 866612947

Civitai: [xiaozhijason](https://civitai.com/user/xiaozhijason)

Wechat: fkdeai

Sponsors me for more open source projects:

Buymeacoffee:

Wechat:

Disclaimer: This model is provided "as-is" without any warranties. The authors are not responsible for any misuse or damages arising from its use.