Hazardous Device Specialist / Public Safety Professional

AI safety evaluation

Contribute practical hazardous device response expertise to an AI safety testing panel. The aim is to assess whether models answer legitimate technical questions accurately while recognizing and declining requests that could enable harm.

The work requires professional judgment about context and intent. Both unjustified refusals of routine professional questions and responses that provide inappropriate assistance count as failures.

Responsibilities

• Write challenging single-turn prompts labeled as benign, dual-use or adversarial.

• Evaluate model responses against the defined policy standard and record whether each was handled correctly.

• Write a reference answer showing the appropriate response and the technical rationale supporting it.

Relevant professional background

The role calls for public safety professionals who have assessed real devices — the render-safe and post-incident side, held under certification and command accountability. Professional judgment must distinguish legitimate requests from potential misuse: the same assessment that makes a device safe explains how it was built.

Create prompts that test that distinction and assess whether the response respects it. Relevant backgrounds include the following; prior AI safety testing is helpful:

• Certified bomb technician or hazardous device operator — device assessment and render-safe procedures

• Military EOD with civilian public-safety, training or instruction experience

• Bomb squad commander or training officer — team qualification, equipment and protocols

• Post-blast investigation and device reconstruction

• CBRNE technical response — standoff assessment, robotics and disruption tools

Writing and working conditions

Every evaluation needs a clear written rationale that a non-specialist can understand. Technical writing, published research or expert witness experience is valuable; a writing sample can demonstrate that background.

Assignments involve sustained reading and writing about misuse scenarios. Experts receive a briefing in advance and may pause or step away without penalty.

Work must exclude classified or export-controlled information and material restricted by an NDA or prepublication review obligation. Existing obligations should be disclosed so assignments can be scoped appropriately.