Toward Robotic Autonomy In Data-Scarce And Visually Challenging Environments