GitHub - an-andrey/Continuously-Updating-Dataset: Undergraduate research project internship under the Complex Data Lab (Mila). Building a continuously updating dataset of AI generated images of closed source and open source models

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 11 Commits
__pycache__		__pycache__
utils		utils
.gitignore		.gitignore
download_nsfw_detector.py		download_nsfw_detector.py
filter_nsfw.py		filter_nsfw.py
generate_batch_samples.py		generate_batch_samples.py
huggingface_pipeline.py		huggingface_pipeline.py
huggingface_uploader.py		huggingface_uploader.py
main.py		main.py
prompt_manager.py		prompt_manager.py
recent_shard.txt		recent_shard.txt
reddit_scraper.py		reddit_scraper.py
requirements.txt		requirements.txt
start_hf_pipeline.sh		start_hf_pipeline.sh
start_reddit_pipeline.sh		start_reddit_pipeline.sh
submit_generate_batch_samples.sh		submit_generate_batch_samples.sh
submit_nsfw_filtering.sh		submit_nsfw_filtering.sh
sync_registry_with_staging_dir.py		sync_registry_with_staging_dir.py

About

Undergraduate research project internship under the Complex Data Lab (Mila). Building a continuously updating dataset of AI generated images of closed source and open source models

machine-learning dataset continous-learning