Considering the small size of Pangkor and just how much jungle to explore, I'd certainly not dismiss Pangkor.
There are a number of firms that run ferries back and forth including Rottnest Express and Oceanic Cruises. https://classifieds.ocala-news.com/author/shanakilvin