Tras el exitoso álbum en vivo "An Idiot Prayer" y el evento de transmisión en vivo lanzado este año, Nick Cave Productions & BMG anuncian B-SIDES & RARITIES PART I & II que se lanzarán internacionalmente el 22 de octubre de 2021. B-SIDES & RARITIES PART I & II contiene material de Nick Cave y los más de 30 años de carrera de Bad Seeds.
En esta ocasión, el formato elegido es un 3CD. 
 
CD 1
1 Deanna (Acoustic Version) 02:51
2 The Mercy Seat (Acoustic Version) 03:45
3 City of Refuge (Acoustic Version) 02:42
4 The Moon Is in the Gutter 02:35
5 The Six Strings That Drew Blood 04:47
6 Rye Whiskey 03:27
7 Running Scared 02:06
8 Black Betty 02:33
9 Scum Explicit 02:53
10 The Girl at the Bottom of My Glass 04:48
11 The Train Song 03:26
12 Cocks 'n' Asses 05:43
13 Blue Bird 02:46
14 Helpless 03:51
15 God's Hotel (Live Radio Session for KCRW Santa Monica) 03:07
16 (I'll Love You) Till the End of the World 03:58
17 Cassiel's Song 03:35
18 Tower of Song 05:39
19 What Can I Give You? 03:40
 
CD 2
1 What a Wonderful World 03:04
2 Rainy Night In Soho 03:58
3 Lucy (Version #2) 02:23
4 Jack the Ripper (Acoustic Version) 04:45
5 Sail Away 04:13
6 There's No Night Out in the Jail 03:43
7 That's What Jazz Is to Me 05:05
8 The Willow Garden 03:59
9 The Ballad of Robert Moore and Betty Coltrane 03:35
10 King Kong Kitchee Kitchee Ki-Mi-O 03:10
11 Knoxville Girl 03:36
12 Where the Wild Roses Grow (Original Guide Vocal Version) 03:46
13 O'Malley's Bar Pt. 1 05:16
14 O'Malley's Bar Pt. 2 06:39
15 O'Malley's Bar Pt. 3 04:55
16 Time Jesum Transeuntum Et Non Riverentum 06:22
17 O'Malley's Bar Reprise 01:02
18 Red Right Hand (Scream 3 Version) 06:01
 
CD 3
1 Little Empty Boat Explicit 04:26
2 Right Now I'm A-Roaming 04:21
3 Come Into My Sleep 03:47
4 Black Hair (Band Version) 04:13
5 Babe, I Got You Bad 03:51
6 Sheep May Safely Graze 04:14
7 Opium Tea 03:48
8 Grief Came Riding 05:05
9 Bless His Ever Loving Heart 04:02
10 Good Good Day 04:04
11 Little Janey's Gone 02:59
12 I Feel So Good 01:44
13 Shoot Me Down 03:32
14 Swing Low 05:40
15 Little Ghost Song 03:44
16 Everything Must Converge 03:17
17 Nocturama 04:01
18 She's Leaving You 04:01
19 Under This Moon 04:01