Is the creativity process a prerogative of the human mind? Exploring new concepts, new different solutions to a given problem, or, more simply, taking into account an upcoming event never observed before, at present seems to be a challenging task for an artificial system. An efficient approach inspired by the human special way to address the concept of “new” should take into account a mix of hierarchical abstract and interconnected conceptual levels to be processed by an adaptively “fluid” artificial neural machine. Such approach would break several present constraints in the field of neural networks and deep learning, where the influence of static architectures and training algorithms limit the potential development of more promising neural topologies, mainly based on natural cognitive mechanisms, and allowing, at the same time, to deal with an incomplete knowledge of the perceived external world. In my research, I try to explore this unknown domain, looking for new neural architectures and efficient unsupervised training mechanisms driven by changing non-stationary environments, aimed at the identification and comprehension of an ecological artificial mind.