So you should only honor Jesus not worship him

... so for my case I've been praying to Jesus since I was young kid

...am I in trouble for not praying to God

...is God mad
I hope this may help you understand the concept.
Jesus is the savior, saved us from our sins. (Read how sin made us distant from GOD) GOD doesn't accept sin. Jesus took upon our sins for us so that we can be saved.
When Jesus was hanging from the cross, the earth got dark. Understand why that happened.
Now they are one but you look at that One and they portray different aspects such as GOD being the almighty and Jesus being the savior.
I'll try and bring it closer to home.
You are one person, but you can play different roles, (this was how a OG told me)
You are the son of your mother (you act as a son to her)
You may be a school teacher, as your occupation (you play that role as a school teacher in society)
You also may be a brother to one of your siblings (you play that role as a brother in society/family)
You may be a Youth Basketball Coach, the kids call you coach such and such (another role)
All of these roles goes back to ONE person which is you, you are define to project these roles that I listed and because of their title and the role you project the actions in regards to said titles/roles.
Same way with the Father, Son, and Holy Ghost/Spirit.
So ppl praying and ending their prayers with Jesus are simply thanking Jesus (GOD) for being their savior and taking up their sins with his blood, and they are praying to (GOD) the FATHER for being the creator of their life and blessing them with another day and they thank the holy ghost (GOD) for being a comforter for them through their day.
3 different roles but all goes back to one GOD.
Not saying this is 100% accurate but again an OG told me to look at it in this context.