The “shortly after” bit can be tricky, if you expect them to stick around for a bit and then churn out. But you could get started by using the Funnel chart from your key event to next Start Session or equivalent, and then creating a cohort of those users who did not convert. You can do this by clicking on the non-converted part of the second event bar and choosing Create cohort.

I hope this helps!