The Gag protein of HIV-1 directs the particle assembly process. Gag recruits components of the cellular vesicular trafficking machinery in order to traverse the cytoplasm of the cell and reach the particle assembly site. The plasma membrane is the primary site of particle assembly in most cell types, while in macrophages an unusual intracellular membrane-bound compartment bearing markers of late endosomes and the plasma membrane is the predominant assembly site. Plasma membrane specificity of assembly may be directed by components of lipid rafts and the cytoplasmic leaflet component PI(4,5)P(2). Recent work has highlighted the role of adaptor protein complexes, protein sorting and recycling pathways, components of the multivesicular body, and cellular motor proteins in facilitating HIV assembly and budding. This review presents an overview of the relevant vesicular trafficking pathways and describes the individual components implicated in interactions with Gag.