Pulp

In talking with @jortel, we wanted to see what individual saves do when they are all in one database transaction. Here is an updated output:

1000 units: indidvidual save in seconds: 5.1227333545684814
1000 units: indidvidual save, 1 transaction in seconds: 2.4544191360473633
1000 units: bulk save in seconds: 0.39525651931762695

This shows the bulk_save providing a speedup = 6.2x speedup over the individual save with 1 transaction.

My results:

(env) [vagrant@pulp3 models_benchmark]$ python3 artifact_test.py  --num=1000
1000 artifacts: individual save in seconds: 4.238337755203247
1000 artifacts: individual save w/ single transaction in seconds: 1.3964695930480957
1000 artifacts: bulk save in seconds: 0.17695045471191406

(env) [vagrant@pulp3 models_benchmark]$ python3 artifact_test.py  --num=1000
1000 artifacts: individual save in seconds: 5.350154876708984
1000 artifacts: individual save w/ single transaction in seconds: 1.6045520305633545
1000 artifacts: bulk save in seconds: 0.22559666633605957

(env) [vagrant@pulp3 models_benchmark]$ python3 artifact_test.py  --num=5000
5000 artifacts: individual save in seconds: 24.522949934005737
5000 artifacts: individual save w/ single transaction in seconds: 7.073785781860352
5000 artifacts: bulk save in seconds: 0.9437673091888428

(env) [vagrant@pulp3 models_benchmark]$ python3 artifact_test.py  --num=5000
5000 artifacts: individual save in seconds: 23.55579137802124
5000 artifacts: individual save w/ single transaction in seconds: 7.318872451782227
5000 artifacts: bulk save in seconds: 1.001615285873413

(env) [vagrant@pulp3 models_benchmark]$ python3 artifact_test.py  --num=10000
10000 artifacts: individual save in seconds: 58.14913988113403
10000 artifacts: individual save w/ single transaction in seconds: 14.900865077972412
10000 artifacts: bulk save in seconds: 2.214111566543579

(env) [vagrant@pulp3 models_benchmark]$ python3 artifact_test.py  --num=10000
10000 artifacts: individual save in seconds: 57.241849422454834
10000 artifacts: individual save w/ single transaction in seconds: 15.238527297973633
10000 artifacts: bulk save in seconds: 2.1400439739227295

(env) [vagrant@pulp3 models_benchmark]$ python3 artifact_test.py  --num=20000
20000 artifacts: individual save in seconds: 97.95429253578186
20000 artifacts: individual save w/ single transaction in seconds: 32.283968925476074
20000 artifacts: bulk save in seconds: 4.602828502655029

(env) [vagrant@pulp3 models_benchmark]$ python3 artifact_test.py  --num=20000
20000 artifacts: individual save in seconds: 90.98556280136108
20000 artifacts: individual save w/ single transaction in seconds: 28.93546438217163
20000 artifacts: bulk save in seconds: 4.149221420288086

All using the same model as currently in Pulp. Django doesn't see it as a "multi-table" model despite that it uses inheritance, I guess it's a bit more subtle than that.