Look around you (normally in the kitchen) and you will find an amazing orchestra of instruments:
Some pans and wooden spoon = drum kit
A container filled with rice or pasta = maraca
A cardboard box and some elastic bands = guitar
Encourage your little one to sing songs along to the music that they are making.