The use of AI, and in particular machine learning, is increasingly being taken up as part of efforts to better understand and mitigate the potential impacts of disasters like earthquakes or floods. Experts and practitioners believe that these tools can help support societal efforts to inform decisions ranging from emergency preparedness to infrastructure retrofitting and the design of disaster insurance products. Despite widespread concerns over the role of AI tools in domains such as criminal justice, banking, and healthcare, little guidance is available for experts working on the tools in the area of disasters. This talk will report on an ongoing effort by organizations including the Red Cross, the World Bank, and several academic institutions to examine the potential for negative consequences of AI in the field of disaster management.