I agree in all points. I also have another essay here that you also might find interesting:

Does Deep Learning always have to reinvent the Wheel?

https://towardsdatascience.com/does-deep-learning-always-have-to-reinvent-the-wheel-2c526018c5c5