Long Short-Term Memory Neural Networks and Guitar Tablature

/ / / C | G F C |
 |: % |-|---|-----||-------------||-----|-----|----------------6--5------8----4-|-|---6-------
 --------5-----|-----3------------------|5--------%
 |-.8------|-8-
 .|-2-|7------------------------7-----|-----------|x----------------------|--------------|-------------||--|2-------------||----------------|-x-------7----|-7----4-4-x--24--8----|-0---|]||4|----2--90-0-/|--0-----||--------------------|-4----00--a0-000-\0-00-00-40-0---0-20--004-
 2-0--0x-4-0-42-0-2%-2-2001--l5|-----12-711|-0-----7x2--0------4--|
 5|---|1-----3---------|||2-----------3-|----|--|------------|-----------|---------------3--7|4------------
 ||5--5--------------|
 2 bgsc ko i
 r@ aO(l' bs ye ] 7T /AAo o -ls5|)|22--010-0-00-0-0-0------2--[2u6I
 4]s5LeEao] avcw s4i ie s e|gb stse Y [eer,a i dE
 g[y Ipaapaetdye] |52--- ( h7seti
 se C Ty/ixkLou] | 
 |Wshyo u ut g |[iemhrr efh r
 ei sp c F

That’s actually not bad!

I let the training run for a while. Interestingly, the temperature being 0.5 tends to yield complete silence:

---------------|---------------|----------------|
|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

This is most likely because the most common sequence is silence: ———-

After the seventh epoch, temperature = 1.0:

---------------|---------------|----------------|
|----------------|---------------|---------------|---------|
|-----------|----------------|-------------------|
| ------5-------|---------------|---------------|---------------|
|3-3-3---3---3--|---------------|---------------||---------------|
|------------#-----------------|---------3-------|
|----------|-----------------|-------------------|----
||[glr 1]                                                       |---------------|---------------|
|5---3----------|---------------|---------------.|----------------||------------------5|---------------|
|7--7-7-----5------|
|3-------3--3--3-|5--------------|--7---7---7-7--|
|7--------------|--------6---------|9---7------------|
|-.--------------------|----------------------|---
||--0-0-0-0-0-0-0-0-x-x--|x0-0-0-0-0-0-0-0|x-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|
|-----------2--||---------------|---------------|---------------|
|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0---|0-0-0-0-0-0-0-0|
|---------------|---------------|---------------|-------|

That’s almost a legitimate tab!

After 12 epochs, temperature=0.5, we get a 14-string guitar tab…

--|5---0---|4-----|5---0---|4-------|0---0---|
|5-------|5---0---|5-------|5-------|5-------|5-------|
|--------|--------|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|--------|--------|--------|--------|--------|--------|--------|--------|--------|
|--------|--------|--------|------

After epoch fifteen…

-- Test with temperature of 1.0 --
--------------|-------------------|-------|
[CHORRES]
  |Esus4            |             | 
3'd gote how come  you  F        x2204x-                        %          |
S INPatgent a fouter floy the striml? Bust by  wonthethertdppnbpally buf you. Acully tay lecco`-
      qe be    F e          F77m7 Fm7         FB7      
                      F
A                     Bm      -
Le'd dongo ax and wayk hous mud d mim the feat 
[VBRSE tOAx]
========================================================
SSENSHARC
Ad The Who
Written by Pete Townshend (c)1969 Fabuloou Music Ltd,
#-----------------------------------PLEASE NOTE------------------------------5--#
Mr's  The  byTusthin ]
-----------------------------------------------------#
=======================================================
SOUSSMBRISMEID =YAB
Ay The Who
Written by Pete Townshend (c)-969 Fabulous Music Ltd.
#------------------------------------EL
LOREEGmtris                     [wrtted Nowr predelt d)Bb          Whotabs                           x2
|------------------|------

Additional output below.

EPOCH 43
-- TESTING...
-- Test with temperature of 1.0 --
--0--0|--------|-----0--|--000000|00000000|
|--------|--------|--------|
|--------|--------|--------|--------|
|--------|--------|--------|--------|
|[bass]Γö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├í |
|0.-0--0-|0---0----------|0-------|----0--------|--------|---------------|
|--5-----|----5---4-----|7------|---------------|--------|
|5--5--5 |5----|5-----|5-----|5-----|5-------|5-------|
|4------|4-------|4----|------|4-----|4-----|4-------|4-------|
|0-------|-------|0---|------|
|0-----|0-------|--------|--------|
|--------|--------|--------|--------|
|[bass]Γö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├í |
|--------------5-|---------------|--------------7|7-7-7-7-7-7-7-7|7-7-7-7-7-7-7-7|
|---------------|---------------|----------------|
|[acoustic 1]Γö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├í |
|7-----8-----7--|-------------------|7-----8-----10--|---------------|
|8-----8-----8--|-------------------|7-----8-----10-|---------------|
|8-----6--------|--8-x-6---6----|8-----8-----10-|----------------|
|8---x-6-----
-- Test with temperature of 0.5 --
--0--0|--------|-----0--|--000000|00000000|
|---------------|---------------|
|---------------|---------------|----------------|
|[acoustic 1]Γö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├í |
|---------------|---------------|---------------|---------------|
|[acoustic 1]Γö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├í |
|-----------------------------------|------------------------------|
Γö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├í F#7Γö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├íΓö¼├í [Lele bitesentare playe: for mo, the gtrste.
[repeat CHORUS]
She pitball. [CHORUS] |------------------------------------|-----------------------| |-11--------------------|11------------------8---| |--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# Previous transcription by: Mike (sef@icbr.ufl.edu) ============== [2K | Adam | epoch: 044 | loss: 0.13966 | val_loss: 0.07798 -- iter: 83132/83132 -- WARNING:tensorflow:Error encountered when serializing layer_tensor/LSTM. Type is unsupported, or the types of the items don't match field type in CollectionDef. 'list' object has no attribute 'name' WARNING:tensorflow:Error encountered when serializing layer_tensor/Dropout. Type is unsupported, or the types of the items don't match field type in CollectionDef. 'list' object has no attribute 'name' -- TESTING╬ô├ç┬¬ -- Test with temperature of 1.0 -- Third update Note: Most of dravh thouthem praye wish play ahe buthe as. [VERSE] G B7 Gm7sus4 E5 G5 G5 B5 B5 I'm free. A -----------------------------------5------------------------------------------------------# Previous-transcriptt| TI The Khorsher or fou dhink is gonde. E |[gur 1] | |-------------0-|---------------|---------------|--------------| |---------------|---------------|---------------|---------------| |---------------|--0-0-0-0-0-0-0|---------------|--------------| |---------------|---------------|---------------|---------------| |---------------|---------------|---------------|---------------| |[electric] [NOte: saand and bling: Em/B 3 -3 -3 | |-----------------------------|-------------------------------| ||G | |--------|--------|--------|--------|----- -- Test with temperature of 0.5 -- Third update Note: Most of the stagong. -------------------------------------------------------------------------------------------------------------------# Previous transcriptt------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# Mr=================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================== --------------------------------- -- TESTING╬ô├ç┬¬ -- Test with temperature of 1.0 -- -|--8---8---6----|8-----8-----10-|----------------| |8---x-8-----8--|--10-(8)10-8-------|8-----8-----8--|---7----|---9---| |--------|--------|--------|--------|--------|--------|--------| |0---- --|0---0---|0----0---------|--------------| |0-------|0-------|0---------------|---------------| |0--------------|---------------|---------------|----------------| |0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|-0-0-0-0-0-0-0-0| |---------------|---------------|---------------|---------------| |---------------|2--------------|---------------|---------------|---------------| |[acoustic 1/2] | |-----------|------------------|------------|------| gtr 12 12----10/12-|----11-----11--|11-111111111111111111111112|-----| |11--11--11--11--|---11/12--12--|------|--------|------|-------| |-----|------|---------------| |--------|-------------|-------|-------------|-------|---------------| |[electric] || |3-----------------| |-0--0---2-----0------|-0|-----------------|| ||-0-0-0-0-0-0 -- Test with temperature of 0.5 -- -|--8---8---6----|8-----8-----10-|----------------| |7---9----------|--7---9---5----|7-----9-----11-|----------------| |0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0-| |---------------|---------------|---------------|---------------| |---------------|---------------|---------------|----------------| |---------------|---------------|----------------| |[acoustic 1] | |------------------------------|-------------------------------| |----10 1--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------- I|---------------|----------------|---------------| A7 D/C Bb G7 Gm I'm free. G A D D* [Lele sinna bringtr] E5-65 B5 |B | ----------------------------|------------------------------| |------------------------------|-----------------------| |-----------------------|-----------------------| |-10-------------------|-10--------------------| |------------------------|---------------------|-3-2--0--0-| |----------- ------------|---------------------|-----------------| |---------------|---------------|---------------|---------------| |[acoustic 2; ppopetin for panngorn] |[electric] | |6--------------|--7---- -------| |0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0-0| |---------------|---------------|---------------|----------------| |---------------------|-3----------- -- Test with temperature of 0.5 -- yed in standard tuning same as below and begin at bas hear find. [BRIDGE] F D/A [INTRRO] [INTRO Spark: The Kar-- Wer------Wome and forcathord I've formaring and rishe the somme. | |---------------|---------------|---------------|---------------| |---------------|---------------|---------------|---------------| |----------------|---------------|---------------|---------------| |---------------|---------------|---------------|---------------| |[acoustic 1/2] | |7--------------|----------------|------------------|----------------|---------------| |-2----2--------|---------------|---------------|---------------| |---------------|---------------|---------------|---------------| |[acoustic 1/2] [2K | Adam | epoch: 047 | loss: 0.13825 -- iter: 83072/83132 Training Step: 30550 | total loss: 0.12924 | time: 145.633s [2K | Adam | epoch: 047 | loss: 0.12924 | val_loss: 0.07769 -- iter: 83132/83132 -- WARNING:tensorflow:Error encountered when serializing layer_tensor/LSTM. Type is unsupported, or the types of the items don't match field type in CollectionDef. 'list' object has no attribute 'name' WARNING:tensorflow:Error encountered when serializing layer_tensor/Dropout. Type is unsupported, or the types of the items don't match field type in CollectionDef. 'list' object has no attribute 'name' -- TESTING╬ô├ç┬¬ -- Test with temperature of 1.0 -- | |-----------------------------|------- |------------------------------------|---------| |7-7-7-7-7-7-7-7-7-7-7-|-7-7-7-7-7-7-7-7-7-7-7-|| ||-----------------------|| ||------------------------3--------|| ||---------------------------|| ||-----------------------------|------------------------| |-----------------------|-----------------------| |/7--------------------------|---------------------4-| |-6----6---- --------6-|-6---------------------| |-6-------------------|-6---------------------| |-8--------------------|-8---------------------| | |----------------|----------------|---------------| |[acoustic 2] | |2-------|5---0---|4-------|0---5---|4-------|0---5---|4-------|0---5---|4-------|0---5---|4-------|0---5---|4-------|0---5---| |3-------|3---3---|5-------|5-------|5-------|5--- |--| |--------|--------|--------|--------|--------|--------|--------|--------|---- -- Test with temperature of 0.5 -- | |------------------------------|------------------------| |----------------------|-----------------------| |/7--------------------------|---------------------4--| |-----------------------|-------------------------| |----10/12---------------------------|| ||---------------------------|---------------------|--------------------| |-----5------------------------|-------------------------------| ||-------------------------|-------------------------------| |D | |D | | | |7-----8-----7--|-------------------|7---------------|----------------| |0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0| |---------------|---------------|---------------|---------------| |---------------|---------------|---------------|---------------| |[acoustic 2] | |6------|5-------|4-------|--------|4-------|--------|4-------|--------|4-------|--------|4------- --------------------------------- ||----------------------------------|--------------------------------| |D |-----------------|7T------------------| |[bass] transcribed by Whotabs litgo@aol.com rev2220110222211 | |----------------|------------------|---------------------------| b|----------------------------------|-------------------------------| |----10/12--------------------------------------------# =========================================================== INLRTERE By The Who Written by Pete Townshend (c)1969 Fabulous Music Ltd. #----------------------------------PLEASE NOTE---------------------------------# #This file is the author's own work and represents their interpretation of the # #song. You may only use this file for private study, scholar -- Test with temperature of 0.5 -- eping. (F#) Em Bm7 Em Bm7 MAb | |-------------------------------|-------------------------------------| |-----------------------------------|------------------------| |------------------------------------|-------------------------------| |D |--------------------|-6---------------------| |----------------------|-----------------------| |---------------------------------|5------------------------------------|0--0---------------------------| ||-----------------------------------|-------------------------------------| |D |D | D/C | A | | | |-----------------------------------|-------------------------------| |D | |D --------------------------------- revised by Whotabs litgo@aol.com rev222 -- Test with temperature of 0.5 -- -------|--------------|4----4---|---4---4------| |2-2-2-2-2-2-2-2-|2-2-2-2-2-2-2-2|2-2-2-2-2-2-2-2|2-2-2-2-2-2-2-0| |-------------------------------|------------------------| |------------------|----------------------| |-----------------|-----------5-5-3|---------------|---------------|---------------| |---------------|---------------|---------------|---------------| |[acoustic 1] | |-----------------------------|-----------------------| |-10-------------------|-10--------------------| |-10-------------------|-10--------------------| |-10-------------------|-10--------------------| |-10-------------------|-10--------------------| |-10-------------------|-10--------------------| |-10------------------------|-1----------------------------3| Eb Dsus4 ||---------------|---------------|---------------| |----------------|--------------------|--------------------| |----------------|---------------- --------------------------------- Run id: lstmmmmmmmmmm 2[2K Training Step: 32499 | total loss: 0.11536 | time: 138.266s [2K | Adam | epoch: 050 | loss: 0.11536 -- iter: 83072/83132 Training Step: 32500 | total loss: 0.10930 | time: 145.790s [2K | Adam | epoch: 050 | loss: 0.10930 | val_loss: 0.06763 -- iter: 83132/83132 -- WARNING:tensorflow:Error encountered when serializing layer_tensor/LSTM. Type is unsupported, or the types of the items don't match field type in CollectionDef. 'list' object has no attribute 'name' WARNING:tensorflow:Error encountered when serializing layer_tensor/Dropout. Type is unsupported, or the types of the items don't match field type in CollectionDef. 'list' object has no attribute 'name' -- TESTING╬ô├ç┬¬ -- Test with temperature of 1.0 -- ---------------|--------|-----------------| |--------|---------------|--------|-------------3---| |--------|---------------|--------------------| |-------------------------|-------------------------------------| |-----------------------------------|----------------------------| |-------------------------------------|----------------------| |[bass] | |--------------5-|---------------|---------------|--------------| |---------------|---------------|---------------|---------------| |[acoustic 2] | |---------------|---------------|------5--------|---------------| |---------------|---------------|---------------|---------------| |---------------|-------------3-|5--------------|------------------| |0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0|0-0-0-0-0-0-0-0-| |---------------|---------------|---------------|-----------------| |------------------|-----------------|---------------| reve- -- Test with temperature of 0.5 -- ---------------|--------|-----------------| |--------|---------------|--------|--------------3|--------|---------------|--------|-----------------| |--------|---------------|--------|--------------3|--------|-------------3---| |--------|---------------|----------------------|-----------|---------| |[bass] | |------------------------------|-------------------------------| ||-------------------------------------|-------------------------------| | |------------------------------|-----------------------| |/9-------------------------|---------------------| |-----5-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# Mrikk is

As you can see, it does a pretty good job. I think I need more training data!

Pages: 1 2

August Karlstedt

Machine Learning Researcher, Software Engineer, Game Developer, and Consultant