Vector-borne disease transmission is a common dissemination mode used by many pathogens to spread in a host population. Similar to directly transmitted diseases, the within-host interaction of a vector-borne pathogen and a host's immune system influences the pathogen's transmission potential between hosts via vectors. Yet there are few theoretical studies on virulence-transmission trade-offs and evolution in vector-borne pathogen-host systems. Here, we consider an immuno-epidemiological model that links the within-host dynamics to between-host circulation of a vector-borne disease. On the immunological scale, the model mimics antibody-pathogen dynamics for arbovirus diseases, such as Rift Valley fever and West Nile virus. The within-host dynamics govern transmission and host mortality and recovery in an age-since-infection structured host-vector-borne pathogen epidemic model. By considering multiple pathogen strains and multiple competing host populations differing in their within-host replication rate and immune response parameters, respectively, we derive evolutionary optimization principles for both pathogen and host. Invasion analysis shows that the [Formula: see text] maximization principle holds for the vector-borne pathogen. For the host, we prove that evolution favors minimizing case fatality ratio (CFR). These results are utilized to compute host and pathogen evolutionary trajectories and to determine how model parameters affect evolution outcomes. We find that increasing the vector inoculum size increases the pathogen [Formula: see text], but can either increase or decrease the pathogen virulence (the host CFR), suggesting that vector inoculum size can contribute to virulence of vector-borne diseases in distinct ways.