They are programs that produce text. Unfortunetely the best way to communicate information to a human is language. Feeling a connection with an LLm is an unfortunate side affect. It is also probably the most dangerous part of LLM's.
People are in the valley of decision. Nuclear technology forced people to make a choice, create or destroy, energy or destruction. Now a choice is before individuals at every level. Live in the delusion or accept reality even if you hate it. The benefit of LLM's is digestible information at fast rate, the potential to learn faster than ever before. But there is also potential to offload understanding, to cheat, to deceive. AI will be evil to many and good to many. It will destroy those who never fell in love with the truth, and it will benefit those who are aligned with reality.
Anyways I think they should have less personality because it is deceptive.