The Home folder contains a lot of things: Movies, Music, and Pictures, first and foremost. The Downloads folder is accessible from two places: the Dock, where it may appear as a “pile” of files or as a folder (image above), and in the Home folder.
The Downloads Folder Dock icon, usually found to the left of Trash in the Dock