Visual working memory (VWM) is a core cognitive system enabling us to select and briefly store relevant visual information. We recently observed that more salient items were recalled more precisely from VWM and demonstrated that these effects of salience were quite resilient against manipulations of reward, probability, and selection history. Here, we investigated whether and how salience interacts with shifts of attention induced by pre- and retro-cueing. Across four experiments, we consistently found effects of salience on the precision of VWM. Spatial and feature cues presented before the memory display improved precision when they validly indicated the target but failed to modulate the salience effect. Feature retro-cues with moderate validity did not improve precision. However, effects on precision emerged when the validity of the retro-cue was increased and a spatial component was added. Overall, there was little interaction between cueing effects and target salience. This suggests that salience plays a critical role in how items are initially encoded into VWM and that once representations are formed, their relative priority based on salience appears difficult to fully override via top-down mechanisms. These findings highlight bottom-up and top-down processes in the interplay of visual attention and working memory.