Conservation of the world’s ecosystems can occur through multiple legal pathways, from protected areas that focus on biodiversity conservation to national scale policies and laws that coordinate, manage, and regulate uses of ecosystems. Protected areas have mixed benefits for biodiversity outcomes; what is less clear is how best to evaluate the benefits of national policies and laws for ecological outcomes. We will provide a brief introduction to impact evaluation for marine scientists, and show an example of using causal analysis to ask if national policies have prevented mangrove deforestation. We used global databases of conservation policies and mangrove deforestation to attribute change in deforestation to policies. We found that policies that restricted cutting and clearing reduced mangrove losses by up to 59% compared to a baseline of no cutting policies, but the effectiveness of these policies has diminished more recently. Our results show that conservation can occur beyond protected areas and that national scale policies and laws are an important pathway for mangrove conservation. More generally, impact evaluation methods are rarely used in marine science, where policy assessments have largely relied on correlative analyses. Adopting causal, counterfactual approaches offers major opportunities to strengthen evidence on what works to protect marine ecosystems and to better inform policy and investment decisions.